00000001:02000400:0.0F:1788664054.015204:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788664070.826492:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788664073.441076:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 759 MB/s 00000001:01000000:1.0F:1788664073.691193:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 311 MB/s 00000001:01000000:2.0:1788664073.941599:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3171 MB/s 00000020:02000000:1.0:1788664075.140459:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_4_g3b30273 00000400:02000000:0.0:1788664076.872206:0:3291:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.114@tcp [8/256/0/180] 00008000:02000000:0.0:1788664081.640505:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788664137.829053:0:5247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788664148.683471:0:5836:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:1.0:1788664148.683480:0:5836:0:(obd_mount.c:924:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788664148.683692:0:5836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000025c4f66a 00000080:02000400:1.0:1788664148.683708:0:5836:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788664148.690548:0:5836:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788664148.690569:0:5836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788664148.690728:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000cc06463) 00000020:00000080:2.0:1788664148.690764:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788664148.720718:0:5836:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788664148.721331:0:5836:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788664148.758884:0:5836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788664148.758913:0:5836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788664148.758926:0:5836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788664148.758959:0:5836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788664148.758977:0:5836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788664148.760831:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788664148.760845:0:5836:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788664148.760858:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be8fe40 00000020:01000004:1.0:1788664148.760867:0:5836:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788664148.760872:0:5836:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788664148.760877:0:5836:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025c4f66a from MGS 00000020:01000004:1.0:1788664148.760882:0:5836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788664148.760914:0:5836:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000cd7a8a29) 00000020:00000080:1.0:1788664148.760925:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788664148.761307:0:5836:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025c4f66a from MGS, refs=2 00080000:01000000:1.0:1788664148.761314:0:5836:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788664148.761320:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be8fe4e 00000100:00100000:1.0:1788664148.761576:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788664148.761799:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788664148.761807:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788664148.762834:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788664148.762843:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788664148.764273:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664148.764866:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788664148.764874:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788664148.765935:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788664148.765946:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788664148.766765:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788664148.766775:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788664148.770747:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664148.770756:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664148.770759:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664148.773829:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664148.773839:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664148.773843:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664148.775300:0:5836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788664148.778037:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0F:1788664149.026610:0:5836:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1936 MB/s 00000001:01000000:1.0:1788664149.278328:0:5836:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1992 MB/s 00000001:01000000:1.0:1788664149.529023:0:5836:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 355 MB/s 00000001:01000000:2.0:1788664149.779104:0:5836:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 451 MB/s 00080000:10000000:3.0:1788664149.786437:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788664149.791861:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788664149.804325:0:5836:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788664149.804380:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788664149.804384:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788664149.805726:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788664149.805900:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788664149.805969:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788664149.806235:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788664149.806264:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788664149.806964:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664149.807266:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788664149.807274:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788664149.808040:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788664149.808049:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788664149.809207:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788664149.809218:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788664149.813994:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788664149.814031:0:5836:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.114@tcp' 00000020:01000004:0.0:1788664149.814034:0:5836:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788664149.814111:0:5836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.114@tcp (typ=mgc) 00000020:00000080:0.0:1788664149.814219:0:5836:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.114@tcp (00000000575ea43f) 00000020:00000080:0.0:1788664149.814246:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788664149.814391:0:5836:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fb1ffa7a@MGC192.168.202.114@tcp: add connection 192.168.202.114@tcp at head 00010000:00010000:0.0:1788664149.814719:0:5836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.114@tcp-0 is initialized 00000040:01000000:0.0:1788664149.814728:0:5836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788664149.815263:0:5851:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788664149.822502:0:5852:0:(mgc_request.c:629:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788664149.830616:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.114@tcp (uuid 25199117-f21d-4733-8eaf-e8fb9fef1d54) 00000020:00000080:0.0:1788664149.830665:0:5836:0:(genops.c:1385:class_connect()) connect: client 25199117-f21d-4733-8eaf-e8fb9fef1d54, cookie 0x762f55027be8fe5c 00000100:00080000:0.0:1788664149.830683:0:5836:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664149.830699:0:5836:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import 00000000fb1ffa7a using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788664149.830769:0:5836:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000024be80f2 x1875550222155904/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664149.830806:0:5836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS 00000020:01000004:0.0:1788664149.830836:0:5836:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788664149.830843:0:5836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788664149.830861:0:5836:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008b3363ca) 00000020:00000080:0.0:1788664149.830876:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788664149.832403:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024be80f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25199117-f21d-4733-8eaf-e8fb9fef1d54:3306:1875550222155904:0@lo:250: 00000100:00100000:3.0:1788664149.834386:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664149.834627:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222155904 00000100:00100000:3.0:1788664149.834637:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222155904 00000100:00100000:3.0:1788664149.834699:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664149.834708:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a2c6c26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875550222155904:12345-0@lo:250: 00010000:00080000:3.0:1788664149.834749:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 25199117-f21d-4733-8eaf-e8fb9fef1d54@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:3.0:1788664149.834786:0:5847:0:(genops.c:1385:class_connect()) connect: client 25199117-f21d-4733-8eaf-e8fb9fef1d54, cookie 0x762f55027be8fe6a 00000100:00080000:3.0:1788664149.834971:0:5847:0:(import.c:65:import_set_state_nolock()) 0000000027f85c7e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664149.835036:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a2c6c26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:3306:x1875550222155904:12345-0@lo:250: Request processed in 328us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664149.835044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664149.835094:0:3306:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788664149.835104:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.114@tcp: connect to target with instance 0 00000100:00080000:3.0:1788664149.835113:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788664149.835118:0:3306:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788664149.835122:0:3306:0:(import.c:65:import_set_state_nolock()) 00000000fb1ffa7a MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788664149.835125:0:3306:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788664149.835137:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788664149.839577:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024be80f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25199117-f21d-4733-8eaf-e8fb9fef1d54:3306:1875550222155904:0@lo:250: 00000100:00100000:1.0:1788664149.870029:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664149.870280:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788664149.870288:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788664149.879232:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788664149.879267:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788664149.884740:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788664149.884755:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788664149.886406:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664149.886620:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788664149.886637:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788664149.887842:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788664149.887854:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788664149.979792:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664149.979991:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788664149.979997:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788664149.982471:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788664149.982482:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788664149.983126:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664149.983744:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664149.983749:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788664149.984214:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664149.984221:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788664149.984996:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664149.985182:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664149.985188:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788664149.986003:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664149.986010:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788664149.986777:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664149.987063:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664149.987133:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788664149.987612:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664149.987619:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788664150.009244:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664150.010742:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788664150.010762:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788664150.013099:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788664150.013115:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788664150.015107:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788664150.015120:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788664150.016083:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788664150.016109:0:5836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788664150.016115:0:5836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788664150.016245:0:5836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788664150.016281:0:5836:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788664150.016286:0:5836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788664150.016288:0:5836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664150.016290:0:5836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664150.016291:0:5836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664150.016292:0:5836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664150.016293:0:5836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664150.016295:0:5836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664150.016296:0:5836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664150.016298:0:5836:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664150.016299:0:5836:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664150.016300:0:5836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664150.016301:0:5836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788664150.016304:0:5836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788664150.016307:0:5836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788664150.016308:0:5836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664150.016309:0:5836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664150.016310:0:5836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664150.016311:0:5836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664150.016312:0:5836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664150.016313:0:5836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664150.016319:0:5836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664150.016320:0:5836:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788664150.016321:0:5836:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788664150.016321:0:5836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664150.016322:0:5836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788664150.018481:0:5836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788664150.018594:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cab30e3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156032:0@lo:253: 00000100:00100000:0.0:1788664150.018706:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664150.018977:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c462318 going to sleep for 11 seconds 00000100:00100000:2.0:1788664150.019037:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156032 00000100:00100000:2.0:1788664150.019046:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156032 00000100:00100000:2.0:1788664150.019127:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664150.019138:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c37d7471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5836:x1875550222156032:12345-0@lo:253: 20000000:01000000:2.0:1788664150.019189:0:5849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788664150.019192:0:5849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788664150.019590:0:5870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788664150.019726:0:5849:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788664150.020231:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664150.021305:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788664150.021598:0:5849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788664150.021603:0:5849:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788664150.021608:0:5849:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788664150.021611:0:5849:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788664150.021623:0:5849:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788664150.021999:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664150.022216:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788664150.022228:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788664150.022278:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788664150.022329:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788664150.022636:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788664150.022774:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788664150.022783:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788664150.024051:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788664150.024069:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788664150.024122:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788664150.024130:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788664150.024163:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788664150.024241:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788664150.024292:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788664150.024298:0:5849:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788664150.024311:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664150.025139:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788664150.025154:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788664150.025210:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788664150.025247:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788664150.025296:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788664150.025310:0:5849:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788664150.025728:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788664150.025753:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788664150.025962:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788664150.026083:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788664150.026125:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788664150.026143:0:5849:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788664150.026288:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788664150.026298:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788664150.026417:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788664150.026457:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788664150.026669:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788664150.026737:0:5849:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788664150.026745:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788664150.028091:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788664150.028635:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788664150.028669:0:5849:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.114@tcp for mdt 20000000:01000000:2.0:1788664150.028671:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:2.0:1788664150.028718:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788664150.028725:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788664150.028755:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788664150.028762:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:2.0:1788664150.028822:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788664150.028833:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788664150.028863:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788664150.028898:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788664150.028965:0:5849:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788664150.028969:0:5849:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788664150.028977:0:5849:0:(mgs_llog.c:5071:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788664150.028985:0:5849:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788664150.030563:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788664150.030770:0:5849:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788664150.041335:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788664150.041434:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1788664150.041520:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1788664150.041540:0:5849:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788664150.041543:0:5849:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788664150.041547:0:5849:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788664150.041599:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788664150.041602:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788664150.041638:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788664150.041641:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788664150.042699:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788664150.043213:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788664150.043265:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788664150.043301:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788664150.043316:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788664150.043319:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788664150.043963:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788664150.044275:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788664150.044320:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788664150.044422:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1788664150.044439:0:5849:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788664150.044458:0:5849:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788664150.044468:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788664150.044496:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044517:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044529:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044536:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044543:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044551:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044558:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b24a51b3 already unused, calling callback (000000000cdd83d6) 00010000:00010000:0.0:1788664150.044562:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044572:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044585:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044594:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.044610:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b24a51b3/0x762f55027be8fe71 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788664150.044633:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788664150.297558:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c37d7471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5836:x1875550222156032:12345-0@lo:253: Request processed in 278407us (278838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664150.297586:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664150.297692:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cab30e3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156032:0@lo:253: 10000000:01000000:0.0:1788664150.297713:0:5836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788664150.297717:0:5836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788664150.297719:0:5836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664150.297721:0:5836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664150.297722:0:5836:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788664150.297723:0:5836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664150.297725:0:5836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664150.297726:0:5836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664150.297728:0:5836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664150.297730:0:5836:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788664150.297731:0:5836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664150.297733:0:5836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788664150.297760:0:5836:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025c4f66a from lustre-MDT0000 10000000:01000000:0.0:1788664150.297792:0:5836:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788664150.297795:0:5836:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788664150.297801:0:5836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b68c3f919c0 10000000:01000000:0.0:1788664150.297806:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664150.297816:0:5836:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff9b68c3f919c0 from 1 10000000:01000000:0.0:1788664150.297819:0:5836:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788664150.297874:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000b24a51b3/0x762f55027be8fe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.297886:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000b24a51b3/0x762f55027be8fe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.297895:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000b24a51b3/0x762f55027be8fe78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664150.297936:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cab30e3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156160:0@lo:101: 00000100:00100000:0.0:1788664150.298054:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664150.298238:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e31e9d68 going to sleep for 11 seconds 00000100:00100000:1.0:1788664150.298285:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156160 00000100:00100000:1.0:1788664150.298294:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156160 00000100:00100000:1.0:1788664150.298333:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664150.298367:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075b6ffc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5836:x1875550222156160:12345-0@lo:101: 00010000:00010000:1.0:1788664150.298383:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664150.298400:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000056f0a9a7/0x762f55027be8fe7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8fe78 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.298429:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000056f0a9a7/0x762f55027be8fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8fe78 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.298450:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000056f0a9a7/0x762f55027be8fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fe78 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.298462:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000056f0a9a7, rc 0) 00000100:00100000:1.0:1788664150.298547:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075b6ffc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:5836:x1875550222156160:12345-0@lo:101: Request processed in 207us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664150.298553:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664150.298663:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cab30e3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156160:0@lo:101: 00010000:00010000:0.0:1788664150.298678:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000b24a51b3/0x762f55027be8fe78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.298686:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000b24a51b3/0x762f55027be8fe78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664150.298739:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cab30e3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156288:0@lo:501: 00000100:00100000:0.0:1788664150.298766:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664150.298839:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e31e9d68 going to sleep for 11 seconds 00000100:00100000:1.0:1788664150.298877:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156288 00000100:00100000:1.0:1788664150.298882:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156288 00000100:00100000:1.0:1788664150.298948:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664150.298955:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012a764ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:5836:x1875550222156288:12345-0@lo:501: 00000100:00100000:1.0:1788664150.299325:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012a764ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:5836:x1875550222156288:12345-0@lo:501: Request processed in 371us (559us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788664150.299333:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664150.299564:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cab30e3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156288:0@lo:501: 10000000:01000000:2.0:1788664150.299595:0:5836:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788664150.299661:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 00000000b24a51b3/0x762f55027be8fe78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.299671:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 00000000b24a51b3/0x762f55027be8fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664150.299681:0:5836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b68d438d000 10000000:01000000:2.0:1788664150.299686:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788664150.299691:0:5836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b68d438d000 10000000:01000000:2.0:1788664150.299694:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788664150.299697:0:5836:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff9b68d438d000 from 1 10000000:01000000:2.0:1788664150.299701:0:5836:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788664150.299751:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000f0ebca96/0x762f55027be8fe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.299759:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000f0ebca96/0x762f55027be8fe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.299767:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000f0ebca96/0x762f55027be8fe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664150.299781:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b26750a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156416:0@lo:101: 00000100:00100000:2.0:1788664150.299857:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664150.299892:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd6a05d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.299960:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156416 00000100:00100000:0.0:1788664150.299966:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156416 00000100:00100000:0.0:1788664150.300068:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664150.300077:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca2bb757 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:5836:x1875550222156416:12345-0@lo:101: 00010000:00010000:0.0:1788664150.300089:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664150.300103:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c55c4c92/0x762f55027be8fe8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8fe86 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.300126:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c55c4c92/0x762f55027be8fe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8fe86 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.300137:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c55c4c92/0x762f55027be8fe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fe86 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.300158:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c55c4c92, rc 0) 00000100:00100000:0.0:1788664150.300189:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca2bb757 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+7:5836:x1875550222156416:12345-0@lo:101: Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.300195:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664150.300269:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b26750a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156416:0@lo:101: 00010000:00010000:2.0:1788664150.300281:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000f0ebca96/0x762f55027be8fe86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.300293:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000f0ebca96/0x762f55027be8fe86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664150.300304:0:5836:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788664150.300496:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 00000000f0ebca96/0x762f55027be8fe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.300504:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 00000000f0ebca96/0x762f55027be8fe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664150.300511:0:5836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788664150.300515:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788664150.300520:0:5836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b68d438d000 10000000:01000000:2.0:1788664150.300524:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788664150.300528:0:5836:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788664150.300530:0:5836:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664150.300549:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 0000000054c01738/0x762f55027be8fe94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.300555:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 0000000054c01738/0x762f55027be8fe94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.300562:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 0000000054c01738/0x762f55027be8fe94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664150.300576:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b26750a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156544:0@lo:101: 00000100:00100000:2.0:1788664150.300603:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664150.300628:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd6a05d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.300688:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156544 00000100:00100000:0.0:1788664150.300693:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156544 00000100:00100000:0.0:1788664150.300724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664150.300730:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf32985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+7:5836:x1875550222156544:12345-0@lo:101: 00010000:00010000:0.0:1788664150.300739:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664150.300747:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa24a603/0x762f55027be8fe9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8fe94 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.300763:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa24a603/0x762f55027be8fe9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8fe94 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.300771:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa24a603/0x762f55027be8fe9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fe94 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.300777:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa24a603, rc 0) 00000100:00100000:0.0:1788664150.300816:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf32985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+8:5836:x1875550222156544:12345-0@lo:101: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.300821:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664150.300906:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b26750a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156544:0@lo:101: 00010000:00010000:1.0:1788664150.300917:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 0000000054c01738/0x762f55027be8fe94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.300924:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 0000000054c01738/0x762f55027be8fe94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.300998:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156672:0@lo:501: 00000100:00100000:1.0:1788664150.301024:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.301048:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018ef7fde going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.301166:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156672 00000100:00100000:0.0:1788664150.301172:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156672 00000100:00100000:0.0:1788664150.301203:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664150.301211:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b62ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+8:5836:x1875550222156672:12345-0@lo:501: 00000100:00100000:0.0:1788664150.301538:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b62ca2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5836:x1875550222156672:12345-0@lo:501: Request processed in 328us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.301554:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664150.301689:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156672:0@lo:501: 00000100:00100000:1.0:1788664150.301723:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156800:0@lo:503: 00000100:00100000:1.0:1788664150.301771:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.301799:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018ef7fde going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.301858:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156800 00000100:00100000:0.0:1788664150.301864:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156800 00000100:00100000:0.0:1788664150.301896:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664150.301902:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5c6f2e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5836:x1875550222156800:12345-0@lo:503: 00000100:00100000:0.0:1788664150.302160:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5c6f2e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5836:x1875550222156800:12345-0@lo:503: Request processed in 259us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.302167:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664150.302271:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222156800:0@lo:503: 00000100:00100000:1.0:1788664150.302684:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5877:1875550222156928:0@lo:502: 00000100:00100000:1.0:1788664150.302726:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.302758:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e464da58 going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.302818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222156928 00000100:00100000:0.0:1788664150.302823:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222156928 00000100:00100000:0.0:1788664150.302869:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664150.302877:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042ed8cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5877:x1875550222156928:12345-0@lo:502: 00000100:00100000:0.0:1788664150.303238:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042ed8cd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5877:x1875550222156928:12345-0@lo:502: Request processed in 361us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.303246:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664150.303461:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5877:1875550222156928:0@lo:502: 00000020:01000000:1.0:1788664150.303499:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664150.303513:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664150.303516:0:5877:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788664150.303523:0:5877:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788664150.303526:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664150.303545:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002c897c46) 00000020:00000080:1.0:1788664150.303569:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788664150.303575:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788664150.303689:0:5877:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788664150.303697:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be8fea9 00000020:00000080:1.0:1788664150.304069:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788664150.304076:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664150.304080:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664150.304081:0:5877:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788664150.304083:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664150.304087:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664150.304088:0:5877:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788664150.304091:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664150.304099:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007c05d01a) 00000020:00000080:1.0:1788664150.304108:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788664150.304111:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788664150.304112:0:5877:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788664150.304115:0:5877:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788664150.304128:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788664150.304183:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025c4f66a from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788664150.304196:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005ca6359a) 00000020:00000080:1.0:1788664150.304204:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788664150.304273:0:5877:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788664150.304278:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be8febe 00000020:00000080:1.0:1788664150.304505:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788664150.304513:0:5877:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788664150.304518:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x762f55027be8fec5 00080000:01000000:1.0:1788664150.304523:0:5877:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788664150.304527:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be8fecc 00080000:10000000:1.0:1788664150.305099:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788664150.305664:0:5877:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788664150.312949:0:5877:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788664150.404937:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788664150.405437:0:5877:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788664150.414500:0:5877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788664150.414930:0:5877:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788664150.496914:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004bd2d3b6) 00000020:00000080:3.0:1788664150.496958:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788664150.497068:0:5877:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788664150.497548:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be8feda 00000020:00000080:3.0:1788664150.506479:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788664150.509332:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788664150.587567:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664150.638527:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664150.679779:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664150.708789:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788664150.733969:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788664150.755853:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x762f55027be8fee1 00000020:00000080:2.0:1788664150.756328:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788664150.756362:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664150.756371:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664150.756374:0:5877:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788664150.756379:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664150.756387:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664150.756388:0:5877:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788664150.756394:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788664150.756446:0:5877:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788664150.756467:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664150.756470:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664150.756472:0:5877:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788664150.756475:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664150.756477:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664150.756479:0:5877:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788664150.756482:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788664150.756484:0:5877:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788664150.756543:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041a0b0d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5877:1875550222157056:0@lo:502: 00000100:00100000:2.0:1788664150.756655:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664150.756727:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb89dbbe going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.756900:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157056 00000100:00100000:0.0:1788664150.756909:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157056 00000100:00100000:0.0:1788664150.756975:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664150.756986:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d2d5af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5877:x1875550222157056:12345-0@lo:502: 00000100:00100000:0.0:1788664150.757274:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d2d5af3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5877:x1875550222157056:12345-0@lo:502: Request processed in 290us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.757282:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664150.757530:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041a0b0d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5877:1875550222157056:0@lo:502: 00000020:01000000:2.0:1788664150.757567:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664150.757575:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664150.757577:0:5877:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788664150.757581:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788664150.757805:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788664150.757827:0:5836:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788664150.757844:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 0000000054c01738/0x762f55027be8fe94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.757857:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 0000000054c01738/0x762f55027be8fe94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664150.757866:0:5836:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68d438d000 from 1 10000000:01000000:1.0:1788664150.757869:0:5836:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788664150.757915:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.757922:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.757932:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.757966:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157184:0@lo:101: 00000100:00100000:1.0:1788664150.758009:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.758056:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d794e567 going to sleep for 11 seconds 00000100:00100000:2.0:1788664150.758164:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157184 00000100:00100000:2.0:1788664150.758169:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157184 00000100:00100000:2.0:1788664150.758309:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664150.758323:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f465703 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:5836:x1875550222157184:12345-0@lo:101: 00010000:00010000:2.0:1788664150.758338:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664150.758389:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8fee8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.758414:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8fee8 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.758425:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fee8 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.758434:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006be65288, rc 0) 00000100:00100000:2.0:1788664150.758469:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f465703 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:5836:x1875550222157184:12345-0@lo:101: Request processed in 147us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664150.758475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664150.758551:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157184:0@lo:101: 00010000:00010000:1.0:1788664150.758564:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.758572:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.759117:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157312:0@lo:256: 00000100:00100000:1.0:1788664150.759169:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.759612:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d794e567 going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.759684:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157312 00000100:00100000:0.0:1788664150.759692:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157312 00000100:00100000:0.0:1788664150.759731:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664150.759738:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018d72bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:5836:x1875550222157312:12345-0@lo:256: 20000000:01000000:0.0:1788664150.759771:0:5848:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788664150.759778:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788664150.759865:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018d72bc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:5836:x1875550222157312:12345-0@lo:256: Request processed in 127us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.759872:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788664150.759963:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157312:0@lo:256: 10000000:01000000:1.0:1788664150.760654:0:5836:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788664150.760681:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.760694:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664150.760703:0:5836:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68d438d000 from 1 10000000:01000000:1.0:1788664150.760705:0:5836:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664150.760743:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.760750:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.760766:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.760784:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157440:0@lo:101: 00000100:00100000:1.0:1788664150.760826:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.760844:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d794e567 going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.761003:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157440 00000100:00100000:0.0:1788664150.761009:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157440 00000100:00100000:0.0:1788664150.761040:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664150.761059:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ea5ab43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:5836:x1875550222157440:12345-0@lo:101: 00010000:00010000:0.0:1788664150.761072:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664150.761088:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8fef6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.761111:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8fef6 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.761121:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fef6 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.761129:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005992e92c, rc 0) 00000100:00100000:0.0:1788664150.761166:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ea5ab43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5836:x1875550222157440:12345-0@lo:101: Request processed in 120us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.761172:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664150.761310:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157440:0@lo:101: 00010000:00010000:1.0:1788664150.761324:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.761333:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.761431:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157568:0@lo:501: 00000100:00100000:1.0:1788664150.761456:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.761478:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d794e567 going to sleep for 11 seconds 00000100:00100000:2.0:1788664150.761538:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157568 00000100:00100000:2.0:1788664150.761545:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157568 00000100:00100000:0.0:1788664150.761757:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664150.761764:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d12e97c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5836:x1875550222157568:12345-0@lo:501: 00000100:00100000:0.0:1788664150.762412:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d12e97c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5836:x1875550222157568:12345-0@lo:501: Request processed in 646us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.762422:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664150.762527:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040d41511 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157568:0@lo:501: 00000100:00100000:0.0:1788664150.762570:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c81bf48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157696:0@lo:503: 00000100:00100000:0.0:1788664150.762614:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664150.762640:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a83233af going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.762655:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157696 00000100:00100000:0.0:1788664150.762660:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157696 00000100:00100000:0.0:1788664150.762684:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664150.762690:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000046a589f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5836:x1875550222157696:12345-0@lo:503: 00000040:00080000:0.0:1788664150.762730:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664150.762767:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000046a589f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5836:x1875550222157696:12345-0@lo:503: Request processed in 77us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.762773:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664150.762811:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c81bf48 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157696:0@lo:503: 00000040:00080000:0.0:1788664150.764090:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788664150.764437:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788664150.764466:0:5836:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664150.764523:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.764538:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664150.764597:0:5836:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788664150.764600:0:5836:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff9b68d438d000 10000000:01000000:1.0:1788664150.764604:0:5836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b68d438d000 10000000:01000000:1.0:1788664150.764623:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788664150.764630:0:5836:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68d438d000 from 1 10000000:01000000:1.0:1788664150.764633:0:5836:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788664150.764674:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 000000008012ac04/0x762f55027be8ff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.764683:0:5836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 000000008012ac04/0x762f55027be8ff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.764694:0:5836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 000000008012ac04/0x762f55027be8ff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.764717:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000df8bd03f pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157824:0@lo:101: 00000100:00100000:1.0:1788664150.764786:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.764835:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f2e789d going to sleep for 11 seconds 00000100:00100000:2.0:1788664150.764893:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157824 00000100:00100000:2.0:1788664150.764902:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157824 00000100:00100000:2.0:1788664150.764958:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664150.764967:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a69d84fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5836:x1875550222157824:12345-0@lo:101: 00010000:00010000:2.0:1788664150.764982:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664150.764997:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ee52ec2/0x762f55027be8ff0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ff04 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.765022:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ee52ec2/0x762f55027be8ff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ff04 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.765033:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ee52ec2/0x762f55027be8ff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff04 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664150.765065:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ee52ec2, rc 0) 00000100:00100000:2.0:1788664150.765118:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a69d84fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5836:x1875550222157824:12345-0@lo:101: Request processed in 151us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664150.765124:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664150.765295:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000df8bd03f pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157824:0@lo:101: 00010000:00010000:3.0:1788664150.765310:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 000000008012ac04/0x762f55027be8ff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664150.765319:0:5836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 000000008012ac04/0x762f55027be8ff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664150.765434:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb12705b pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157952:0@lo:501: 00000100:00100000:3.0:1788664150.765461:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664150.765476:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000718f6d5c going to sleep for 11 seconds 00000100:00100000:3.0:1788664150.765490:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222157952 00000100:00100000:3.0:1788664150.765494:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222157952 00000100:00100000:3.0:1788664150.765515:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664150.765526:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001f9195d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5836:x1875550222157952:12345-0@lo:501: 00000100:00100000:3.0:1788664150.765799:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001f9195d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5836:x1875550222157952:12345-0@lo:501: Request processed in 272us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664150.765806:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788664150.765838:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb12705b pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222157952:0@lo:501: 00000100:00100000:3.0:1788664150.765867:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb12705b pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222158080:0@lo:503: 00000100:00100000:3.0:1788664150.765902:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664150.765914:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 00000000718f6d5c going to sleep for 11 seconds 00000100:00100000:3.0:1788664150.765925:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158080 00000100:00100000:3.0:1788664150.765928:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158080 00000100:00100000:3.0:1788664150.765944:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664150.765948:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c49075d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5836:x1875550222158080:12345-0@lo:503: 00000100:00100000:3.0:1788664150.766179:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c49075d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5836:x1875550222158080:12345-0@lo:503: Request processed in 229us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664150.766186:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664150.766544:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb12705b pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222158080:0@lo:503: 00000100:00100000:1.0:1788664150.767026:0:5882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000573d183d pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5882:1875550222158208:0@lo:502: 00000100:00100000:1.0:1788664150.767099:0:5882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.767174:0:5882:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018ef7fde going to sleep for 11 seconds 00000100:00100000:2.0:1788664150.767285:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158208 00000100:00100000:2.0:1788664150.767292:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158208 00000100:00100000:2.0:1788664150.767451:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664150.767460:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026284eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5882:x1875550222158208:12345-0@lo:502: 00000100:00100000:2.0:1788664150.767773:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026284eb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5882:x1875550222158208:12345-0@lo:502: Request processed in 314us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664150.767782:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788664150.767886:0:5882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000573d183d pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5882:1875550222158208:0@lo:502: 00000020:01000004:3.0:1788664150.768002:0:5882:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788664150.768023:0:5882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000004e08f413) 00000020:00000080:3.0:1788664150.768060:0:5882:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788664150.768156:0:5882:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025c4f66a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788664150.768160:0:5882:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000025c4f66a from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788664150.768162:0:5882:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000025c4f66a 4 00010000:00080000:3.0:1788664150.768218:0:5882:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009e34c459@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:3.0:1788664150.770651:0:5882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788664150.770902:0:5882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788664150.770960:0:5882:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788664150.770977:0:5882:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x762f55027be8ff19 00000100:00080000:3.0:1788664150.770990:0:5882:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664150.770996:0:5882:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e34c459 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664150.772426:0:5882:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cb12705b x1875550222158336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788664150.772495:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb12705b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222158336:0@lo:38: 00000100:00100000:0.0:1788664150.772595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.772715:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158336 00000100:00100000:1.0:1788664150.772725:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158336 00000100:00100000:1.0:1788664150.772763:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664150.772770:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c81bf48 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875550222158336:12345-0@lo:38: 00000100:00080000:3.0:1788664150.774318:0:5882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788664150.774843:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c81bf48 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875550222158336:12345-0@lo:38: Request processed in 2065us (2242us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788664150.774859:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664150.775043:0:5882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041a0b0d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5882:1875550222158464:0@lo:502: 00000100:00100000:2.0:1788664150.775133:0:5882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664150.775161:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158464 00000100:00100000:2.0:1788664150.775169:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158464 00000100:00100000:2.0:1788664150.775473:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788664150.775483:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ffe60e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5882:x1875550222158464:12345-0@lo:502: 00000100:00100000:2.0:1788664150.775738:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ffe60e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5882:x1875550222158464:12345-0@lo:502: Request processed in 256us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664150.775745:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664150.775886:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788664150.775896:0:3306:0:(import.c:65:import_set_state_nolock()) 000000009e34c459 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664150.775901:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788664150.775904:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb12705b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222158336:0@lo:38: 00000100:00100000:2.0:1788664150.778481:0:5882:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c7f9784 going to sleep for 11 seconds 00000100:00100000:2.0:1788664150.778534:0:5882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041a0b0d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:5882:1875550222158464:0@lo:502: 00000040:00080000:2.0:1788664150.778586:0:5882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788664150.781548:0:5836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788664150.781598:0:5836:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788664150.781630:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 000000008012ac04/0x762f55027be8ff04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664150.781645:0:5836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 000000008012ac04/0x762f55027be8ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788664150.781721:0:5836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788664150.781724:0:5836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664150.781726:0:5836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664150.781727:0:5836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664150.781728:0:5836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664150.781730:0:5836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664150.781731:0:5836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664150.781733:0:5836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664150.781735:0:5836:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664150.781736:0:5836:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664150.781738:0:5836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664150.781739:0:5836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788664150.781744:0:5836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788664150.781747:0:5836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788664150.781748:0:5836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664150.781749:0:5836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664150.781750:0:5836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664150.781752:0:5836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664150.781753:0:5836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664150.781763:0:5836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664150.781763:0:5836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664150.781764:0:5836:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664150.781765:0:5836:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664150.781766:0:5836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664150.781767:0:5836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788664150.781804:0:5836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788664150.781829:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2fbc2d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222158592:0@lo:253: 00000100:00100000:3.0:1788664150.781927:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664150.781975:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 0000000079357aba going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.782832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158592 00000100:00100000:0.0:1788664150.782845:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158592 00000100:00100000:0.0:1788664150.782910:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788664150.782919:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5544290 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5836:x1875550222158592:12345-0@lo:253: 20000000:01000000:0.0:1788664150.782961:0:5847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788664150.782980:0:5847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788664150.807692:0:5847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788664150.807709:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788664150.808039:0:5870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788664150.808046:0:5870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788664150.808084:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.808135:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fee8 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.808145:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.808198:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8fee8 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.808216:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8fee8 expref: 12 pid: 5847 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.808235:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ff67e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5870:1875550222158720:0@lo:104: 00000100:00100000:1.0:1788664150.808320:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.808415:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c25d8eb6 going to sleep for 11 seconds 00000100:00100000:0.0:1788664150.808656:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158720 00000100:00100000:0.0:1788664150.808666:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158720 00000100:00100000:0.0:1788664150.808766:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664150.808776:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6e88811 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5870:x1875550222158720:12345-0@lo:104: 00010000:00010000:0.0:1788664150.808791:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664150.808862:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664150.808868:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6e88811 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5870:x1875550222158720:12345-0@lo:104: Request processed in 94us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664150.808876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788664150.808931:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664150.808937:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.808944:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c006b5f2 already unused, calling callback (0000000015e442a4) 10000000:00010000:1.0:1788664150.808948:0:5843:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.808955:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664150.808963:0:5843:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664150.808981:0:5843:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664150.809012:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809019:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664150.809038:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809044:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: 00000000c006b5f2/0x762f55027be8fee8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8feef expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809067:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664150.809085:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664150.809087:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664150.809188:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000126da79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222158848:0@lo:103: 00000100:00100000:1.0:1788664150.809218:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664150.809286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158848 00000100:00100000:1.0:1788664150.809291:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158848 00010000:00010000:1.0:1788664150.809309:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fee8 expref: 13 pid: 5847 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.809329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664150.809334:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d71d83d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3308:x1875550222158848:12345-0@lo:103: 00010000:00010000:1.0:1788664150.809363:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664150.809369:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fee8 expref: 13 pid: 5847 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809379:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8fee8 expref: 13 pid: 5847 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809403:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809411:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788664150.809426:0:5840:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001381833s 00010000:00010000:1.0:1788664150.809430:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809437:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809444:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809449:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809455:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e8100150 already unused, calling callback (000000000cdd83d6) 00010000:00010000:1.0:1788664150.809458:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809465:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809473:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809484:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664150.809512:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d71d83d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3308:x1875550222158848:12345-0@lo:103: Request processed in 178us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664150.809524:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664150.809567:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000126da79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222158848:0@lo:103: 00010000:00010000:1.0:1788664150.809599:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006be65288/0x762f55027be8feef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8fee8 expref: 12 pid: 5847 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.809610:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ff67e1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5870:1875550222158720:0@lo:104: 00010000:00010000:1.0:1788664150.809622:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809631:0:5870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809636:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664150.809641:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e8100150/0x762f55027be8ff20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664150.819027:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5544290 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5836:x1875550222158592:12345-0@lo:253: Request processed in 36097us (37089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664150.819048:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664150.819329:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2fbc2d7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:5836:1875550222158592:0@lo:253: 10000000:01000000:3.0:1788664150.819473:0:5836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788664150.819478:0:5836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664150.819480:0:5836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788664150.819481:0:5836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664150.819482:0:5836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664150.819483:0:5836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664150.819485:0:5836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664150.819486:0:5836:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788664150.819488:0:5836:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788664150.819489:0:5836:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664150.819491:0:5836:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664150.819492:0:5836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664150.819494:0:5836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788664150.819510:0:5836:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788664150.826399:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788664150.828878:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788664150.829216:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788664150.829573:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788664150.829750:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788664150.829959:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788664150.830838:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788664150.832036:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664150.832987:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788664150.833443:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664150.833626:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788664150.833827:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664150.834025:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788664150.873965:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788664150.905573:0:5836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788664150.905955:0:5888:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788664150.911766:0:5836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788664150.912019:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788664150.913850:0:5887:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788664150.913863:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:0.0:1788664150.914413:0:5836:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788664150.914437:0:5836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788664150.933374:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664150.934446:0:5836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788664150.934984:0:5836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788664150.935023:0:5836:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788664150.937994:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788664150.938247:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788664150.939738:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788664150.939868:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788664150.940831:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788664150.941130:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788664150.941444:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788664150.941656:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788664150.941802:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788664150.941946:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788664150.942090:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788664150.942229:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788664150.942892:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788664150.943070:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788664150.943233:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788664150.943734:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788664150.943875:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788664150.944018:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788664150.947806:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788664150.948028:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788664150.948184:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788664150.948390:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788664150.948567:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788664150.948713:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788664150.948853:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788664150.949005:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788664150.953891:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788664150.954286:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788664150.954490:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788664150.954651:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788664150.954808:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788664150.954973:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788664150.955119:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788664150.955305:0:5836:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788664150.955558:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788664150.965180:0:5888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788664151.045586:0:5836:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788664151.045639:0:5836:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac8041c6b988 00100000:10000000:0.0:1788664151.045650:0:5836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788664151.046677:0:5836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788664151.046698:0:5836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788664151.046716:0:5836:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788664151.046740:0:5836:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788664151.060096:0:5888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788664151.060239:0:5888:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1788664151.060244:0:5888:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788664151.839749:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664152.865481:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664153.898331:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664154.913708:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788664155.758094:0:6131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788664155.936520:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664155.936711:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788664155.936718:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788664155.936720:0:38:0:(import.c:65:import_set_state_nolock()) 000000009e34c459 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788664155.936733:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e34c459 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:2.0:1788664155.936754:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e5be5b02 x1875550222159104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664155.936910:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000041a0b0d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222158976:0@lo:400: 00000100:00100000:1.0:1788664155.936980:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664155.941086:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5be5b02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222159104:0@lo:38: 00000100:00100000:2.0:1788664155.941169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664155.941243:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222158976 00000100:00100000:2.0:1788664155.941251:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222158976 00000100:00100000:2.0:1788664155.941295:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788664155.941302:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000354a0142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3309:x1875550222158976:12345-0@lo:400: 00000100:00100000:2.0:1788664155.941373:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000354a0142 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3309:x1875550222158976:12345-0@lo:400: Request processed in 71us (4394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664155.941381:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664155.942533:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222159104 00000100:00100000:1.0:1788664155.942551:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222159104 00000100:00100000:1.0:1788664155.942592:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664155.942598:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff60941a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875550222159104:12345-0@lo:38: 00010000:00080000:1.0:1788664155.942627:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:1.0:1788664155.942669:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x762f55027be8ff27 00000004:00100000:1.0:1788664155.942714:0:5856:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788664155.942864:0:5856:0:(import.c:65:import_set_state_nolock()) 000000000e4081fa : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664155.942936:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff60941a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875550222159104:12345-0@lo:38: Request processed in 337us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664155.942943:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788664155.942993:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e5be5b02 x1875550222159104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788664155.943009:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788664155.943016:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788664155.943021:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664155.943023:0:3306:0:(import.c:65:import_set_state_nolock()) 000000009e34c459 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664155.943028:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5be5b02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222159104:0@lo:38: 00000100:00100000:1.0:1788664155.943058:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000041a0b0d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222158976:0@lo:400: 00010000:00010000:2.0:1788664156.959609:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664157.988703:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788664158.495711:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788664158.495719:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68d438d000 from 3 10000000:01000000:1.0:1788664158.495724:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788664158.495802:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000e8100150/0x762f55027be8ff2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664158.495815:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000e8100150/0x762f55027be8ff2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664158.495842:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000e8100150/0x762f55027be8ff2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664158.495865:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ff67e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222159232:0@lo:101: 00000100:00100000:1.0:1788664158.495940:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664158.496010:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aeb2ddc4 going to sleep for 11 seconds 00000100:00100000:0.0:1788664158.496236:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222159232 00000100:00100000:0.0:1788664158.496245:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222159232 00000100:00100000:0.0:1788664158.496298:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664158.496307:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000878b0666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5852:x1875550222159232:12345-0@lo:101: 00010000:00010000:0.0:1788664158.496321:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664158.496334:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001923d772/0x762f55027be8ff35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ff2e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664158.496381:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001923d772/0x762f55027be8ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ff2e expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664158.496391:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001923d772/0x762f55027be8ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff2e expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664158.496400:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001923d772, rc 0) 00000100:00100000:0.0:1788664158.496467:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000878b0666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222159232:12345-0@lo:101: Request processed in 162us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664158.496474:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664158.496621:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ff67e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222159232:0@lo:101: 00010000:00010000:1.0:1788664158.496635:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000e8100150/0x762f55027be8ff2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664158.496643:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000e8100150/0x762f55027be8ff2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664158.496692:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000058ff67e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222159360:0@lo:256: 00000100:00100000:1.0:1788664158.496724:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664158.496757:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aeb2ddc4 going to sleep for 11 seconds 00000100:00100000:3.0:1788664158.496829:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222159360 00000100:00100000:3.0:1788664158.496834:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222159360 00000100:00100000:3.0:1788664158.496868:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664158.496875:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023f521cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222159360:12345-0@lo:256: 20000000:01000000:3.0:1788664158.496890:0:5848:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788664158.496907:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788664158.496910:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788664158.496998:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023f521cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222159360:12345-0@lo:256: Request processed in 124us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664158.497005:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788664158.497126:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000058ff67e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222159360:0@lo:256: 10000000:01000000:1.0:1788664158.497170:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788664158.497176:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: 00000000e8100150/0x762f55027be8ff2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664158.497184:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: 00000000e8100150/0x762f55027be8ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664159.012182:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664160.032937:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788664160.830205:0:6333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe691ae7a0 20000000:00000080:0.0:1788664160.830226:0:6333:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b68fb33fc00 uarg=0000000000000000 20000000:01000000:0.0:1788664160.830263:0:6333:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788664160.830269:0:6333:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788664160.830275:0:6333:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788664160.830600:0:6333:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788664160.830615:0:6333:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788664160.835189:0:6333:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664160.835633:0:6333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788664160.835692:0:6333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788664160.835737:0:6333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788664160.835756:0:6333:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788664160.835772:0:6333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.835791:0:6333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fef6 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.835798:0:6333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.835839:0:6333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8fef6 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.835853:0:6333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8fef6 expref: 11 pid: 5848 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664160.835867:0:6333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404eb77 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6333:1875550222159488:0@lo:104: 00000100:00100000:0.0:1788664160.835949:0:6333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664160.836004:0:6333:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f90aec05 going to sleep for 11 seconds 00000100:00100000:3.0:1788664160.836222:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222159488 00000100:00100000:3.0:1788664160.836231:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222159488 00000100:00100000:3.0:1788664160.836285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664160.836301:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000640aa06b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:6333:x1875550222159488:12345-0@lo:104: 00010000:00010000:3.0:1788664160.836313:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664160.836388:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664160.836394:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000640aa06b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:6333:x1875550222159488:12345-0@lo:104: Request processed in 103us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664160.836401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788664160.836421:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664160.836426:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664160.836433:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000161638b3 already unused, calling callback (0000000015e442a4) 10000000:00010000:3.0:1788664160.836436:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664160.836450:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664160.836457:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664160.836463:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788664160.836504:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664160.836512:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664160.836712:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664160.836720:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: 00000000161638b3/0x762f55027be8fef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fefd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664160.836736:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664160.836738:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664160.836739:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664160.837091:0:6333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404eb77 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6333:1875550222159488:0@lo:104: 00010000:00010000:0.0:1788664160.837110:0:6333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664160.837573:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664160.837597:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2fbc2d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222159616:0@lo:103: 00000100:00100000:1.0:1788664160.837645:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664160.841484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222159616 00000100:00100000:0.0:1788664160.841501:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222159616 00010000:00010000:0.0:1788664160.841543:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fef6 expref: 12 pid: 5848 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664160.841625:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664160.841634:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ff67e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3309:x1875550222159616:12345-0@lo:103: 00010000:00010000:0.0:1788664160.841650:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664160.841655:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fef6 expref: 12 pid: 5848 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841666:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8fef6 expref: 12 pid: 5848 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841684:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005992e92c/0x762f55027be8fefd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8fef6 expref: 12 pid: 5848 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841699:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841707:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841724:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841740:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841747:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841753:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841758:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9c33e89 already unused, calling callback (000000000cdd83d6) 00010000:00010000:0.0:1788664160.841761:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841767:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841788:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664160.841800:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664160.841875:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ff67e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3309:x1875550222159616:12345-0@lo:103: Request processed in 243us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664160.841882:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664160.841936:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2fbc2d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222159616:0@lo:103: 00010000:00010000:2.0:1788664160.841937:0:6333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664160.841945:0:6333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664160.841959:0:6333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c9c33e89/0x762f55027be8ff3c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664161.055649:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664161.055744:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf1c10ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222159872:0@lo:400: 00000100:00100000:1.0:1788664161.055813:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664161.055867:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664161.055872:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000126da79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222159744:0@lo:400: 00000100:00100000:1.0:1788664161.055899:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664161.055929:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222159872 00000100:00100000:1.0:1788664161.055938:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222159872 00000100:00100000:1.0:1788664161.055985:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664161.056005:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0e169dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222159872:12345-0@lo:400: 00000100:00100000:1.0:1788664161.056059:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0e169dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222159872:12345-0@lo:400: Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664161.056066:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664161.056091:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222159744 00000100:00100000:1.0:1788664161.056095:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222159744 00000100:00100000:1.0:1788664161.056119:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664161.056125:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000402f8343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3308:x1875550222159744:12345-0@lo:400: 00000100:00100000:1.0:1788664161.056151:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000402f8343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3308:x1875550222159744:12345-0@lo:400: Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664161.056157:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664161.056199:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000126da79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222159744:0@lo:400: 00010000:00080000:1.0:1788664161.056214:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cf1c10ea x1875550222159872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664161.056223:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf1c10ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222159872:0@lo:400: 00010000:00010000:3.0:1788664162.079621:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664163.103491:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788664163.617960:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788664163.617967:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68d438d000 from 1 10000000:01000000:2.0:1788664163.617972:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788664163.618079:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: 00000000821409cf/0x762f55027be8ff43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664163.618092:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: 00000000821409cf/0x762f55027be8ff43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664163.618102:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: 00000000821409cf/0x762f55027be8ff43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664163.618183:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000136b1786 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222160000:0@lo:101: 00000100:00100000:2.0:1788664163.618244:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664163.618384:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8e69fad going to sleep for 11 seconds 00000100:00100000:1.0:1788664163.618465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160000 00000100:00100000:1.0:1788664163.618484:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160000 00000100:00100000:1.0:1788664163.618532:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664163.618539:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c524e709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:5852:x1875550222160000:12345-0@lo:101: 00010000:00010000:1.0:1788664163.618551:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664163.618564:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2c95860/0x762f55027be8ff4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ff43 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664163.618585:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2c95860/0x762f55027be8ff4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ff43 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664163.618596:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2c95860/0x762f55027be8ff4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff43 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664163.618605:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2c95860, rc 0) 00000100:00100000:1.0:1788664163.618653:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c524e709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222160000:12345-0@lo:101: Request processed in 115us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664163.618660:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664163.618697:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000136b1786 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222160000:0@lo:101: 00010000:00010000:1.0:1788664163.618709:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: 00000000821409cf/0x762f55027be8ff43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664163.618718:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: 00000000821409cf/0x762f55027be8ff43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664163.618765:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf1c10ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222160128:0@lo:501: 00000100:00100000:1.0:1788664163.618786:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664163.618810:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 0000000070ac5fc5 going to sleep for 11 seconds 00000100:00100000:1.0:1788664163.618820:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160128 00000100:00100000:1.0:1788664163.618824:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160128 00000100:00100000:1.0:1788664163.618841:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664163.618846:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d791db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222160128:12345-0@lo:501: 00000100:00100000:1.0:1788664163.619756:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d791db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222160128:12345-0@lo:501: Request processed in 907us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664163.619764:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664163.620185:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf1c10ea pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222160128:0@lo:501: 00000100:00100000:0.0:1788664163.620232:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404eb77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222160256:0@lo:503: 00000100:00100000:0.0:1788664163.620372:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664163.620401:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3ac9d8c going to sleep for 11 seconds 00000100:00100000:1.0:1788664163.620483:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160256 00000100:00100000:1.0:1788664163.620489:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160256 00000100:00100000:1.0:1788664163.620519:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788664163.620525:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000192e774a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222160256:12345-0@lo:503: 00000100:00100000:1.0:1788664163.621545:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000192e774a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222160256:12345-0@lo:503: Request processed in 1016us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664163.621556:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664163.625929:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404eb77 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222160256:0@lo:503: 00000100:00100000:0.0:1788664163.626569:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007404eb77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6481:1875550222160384:0@lo:502: 00000100:00100000:0.0:1788664163.626663:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664163.626710:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fccf4cf8 going to sleep for 11 seconds 00000100:00100000:1.0:1788664163.626768:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160384 00000100:00100000:1.0:1788664163.626776:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160384 00000100:00100000:1.0:1788664163.626827:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788664163.626836:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5799d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6481:x1875550222160384:12345-0@lo:502: 00000100:00100000:1.0:1788664163.627074:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5799d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6481:x1875550222160384:12345-0@lo:502: Request processed in 239us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664163.627084:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788664163.627148:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007404eb77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6481:1875550222160384:0@lo:502: 00000020:01000000:1.0:1788664163.627175:0:6481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664163.627186:0:6481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664163.627189:0:6481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788664163.627197:0:6481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68d438d000 00000020:00000080:1.0:1788664163.627200:0:6481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788664163.627249:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6481:1875550222160512:0@lo:502: 00000100:00100000:1.0:1788664163.627294:0:6481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664163.627315:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160512 00000100:00100000:1.0:1788664163.627319:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160512 00000100:00100000:1.0:1788664163.627367:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664163.627374:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6481:x1875550222160512:12345-0@lo:502: 00000100:00100000:1.0:1788664163.627492:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6481:x1875550222160512:12345-0@lo:502: Request processed in 118us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664163.627499:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664163.627532:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c894d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664163.627543:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6481:1875550222160512:0@lo:502: 00000020:01000000:1.0:1788664163.627559:0:6481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664163.627563:0:6481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664163.627565:0:6481:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788664163.627568:0:6481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788664163.627624:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788664163.627646:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664163.627657:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664163.627667:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664164.129551:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664165.155655:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664166.179285:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222160640:0@lo:400: 00000100:00100000:2.0:1788664166.179381:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664166.179431:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664166.179437:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222160768:0@lo:400: 00000100:00100000:2.0:1788664166.179467:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664166.179507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160768 00000100:00100000:2.0:1788664166.179516:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160768 00000100:00100000:2.0:1788664166.179564:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664166.179574:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222160768:12345-0@lo:400: 00000100:00100000:2.0:1788664166.179640:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222160768:12345-0@lo:400: Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664166.179649:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664166.179687:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b68f8934380 x1875550222160768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664166.179703:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222160768:0@lo:400: 00000100:00100000:1.0:1788664166.179861:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160640 00000100:00100000:1.0:1788664166.179866:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160640 00000100:00100000:1.0:1788664166.179918:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788664166.179925:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3309:x1875550222160640:12345-0@lo:400: 00000100:00100000:1.0:1788664166.179968:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3309:x1875550222160640:12345-0@lo:400: Request processed in 44us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664166.179981:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788664166.180021:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222160640:0@lo:400: 00010000:00010000:0.0:1788664166.180455:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664167.200893:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664167.330996:0:6692:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:3.0:1788664167.331000:0:6692:0:(obd_mount.c:924:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788664167.331145:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b68f8b62000 00000020:01000004:3.0:1788664167.331162:0:6692:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788664167.331174:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788664167.331189:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b68f8fe8000) 00000020:00000080:3.0:1788664167.331203:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788664167.346400:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788664167.346668:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788664167.368474:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788664167.373779:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788664167.373817:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788664167.373874:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788664167.373912:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788664167.374428:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788664167.374441:0:6692:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788664167.374455:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x762f55027be8ff58 00000020:01000004:2.0:1788664167.374463:0:6692:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788664167.374485:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788664167.374489:0:6692:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788664167.374495:0:6692:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788664167.374499:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788664167.374513:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b68c8fe0000) 00000020:00000080:2.0:1788664167.374526:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788664167.376381:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664167.376559:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788664167.376565:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788664167.384320:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788664167.384338:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788664167.384841:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788664167.384848:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788664167.387042:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664167.387971:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788664167.387979:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788664167.389804:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788664167.389818:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788664167.424855:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664167.425498:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788664167.425608:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788664167.426976:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788664167.426985:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788664167.428522:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788664167.428533:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788664167.431611:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664167.431798:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788664167.431804:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788664167.432962:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788664167.432971:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788664167.478533:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664167.478772:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788664167.478780:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788664167.480254:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788664167.480265:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788664167.480708:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788664167.480735:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788664167.480741:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788664167.500170:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788664167.500211:0:6692:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788664167.500216:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788664167.500218:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788664167.500220:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664167.500221:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664167.500222:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664167.500224:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664167.500225:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664167.500227:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788664167.500228:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788664167.500230:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664167.500231:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788664167.500235:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788664167.500237:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788664167.500239:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788664167.500240:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664167.500241:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664167.500242:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664167.500243:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664167.500244:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664167.500251:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788664167.500252:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788664167.500253:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664167.500254:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788664167.500282:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788664167.500302:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222160896:0@lo:253: 00000100:00100000:2.0:1788664167.500416:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.500567:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.500666:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222160896 00000100:00100000:0.0:1788664167.500674:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222160896 00000100:00100000:0.0:1788664167.500766:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664167.500777:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222160896:12345-0@lo:253: 20000000:01000000:0.0:1788664167.500807:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788664167.500811:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788664167.500816:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788664167.500819:0:5847:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788664167.501971:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664167.502277:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788664167.502290:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788664167.502330:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788664167.502338:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788664167.502560:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788664167.502612:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788664167.502976:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788664167.502998:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:0.0:1788664167.503000:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788664167.503130:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788664167.503139:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788664167.503188:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788664167.503197:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:0.0:1788664167.503229:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788664167.503239:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788664167.503269:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788664167.503389:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788664167.504013:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788664167.504103:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:0.0:1788664167.504105:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:0.0:1788664167.504156:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788664167.504164:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788664167.504197:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788664167.504204:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:0.0:1788664167.504254:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788664167.504264:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788664167.504299:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788664167.504336:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788664167.504381:0:5847:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788664167.504385:0:5847:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788664167.504391:0:5847:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788664167.504392:0:5847:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788664167.504395:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788664167.504407:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788664167.504410:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788664167.504443:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788664167.504445:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788664167.504909:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788664167.505246:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788664167.505285:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788664167.505529:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788664167.505543:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788664167.505545:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788664167.506178:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788664167.506233:0:6708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788664167.506283:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788664167.506594:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788664167.506637:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788664167.506674:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788664167.506686:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788664167.506688:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788664167.507248:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788664167.507524:0:6709:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788664167.507673:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788664167.507928:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788664167.507961:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788664167.508100:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1788664167.508129:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788664167.508149:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508168:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c1479800/0x762f55027be8fe7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fe78 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508176:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c0030600/0x762f55027be8fe9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fe94 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508182:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b690215a000/0x762f55027be8ff0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff04 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508189:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508230:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b690215a000/0x762f55027be8ff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ff04 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508245:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b690215a000/0x762f55027be8ff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ff04 expref: 12 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.508260:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5847:1875550222161024:0@lo:104: 00000100:00100000:0.0:1788664167.508325:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664167.508664:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c0030600/0x762f55027be8fe9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8fe94 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508673:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c0030600/0x762f55027be8fe9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8fe94 expref: 12 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.508682:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5847:1875550222161152:0@lo:104: 00000100:00100000:0.0:1788664167.508713:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664167.508827:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c1479800/0x762f55027be8fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8fe78 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.508836:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c1479800/0x762f55027be8fe7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8fe78 expref: 12 pid: 5848 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.508846:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3415500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5847:1875550222161280:0@lo:104: 00000100:00100000:0.0:1788664167.508868:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.508941:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.508998:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161024 00000100:00100000:3.0:1788664167.509005:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161024 00000100:00100000:3.0:1788664167.509047:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161152 00000100:00100000:3.0:1788664167.509050:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161152 00000100:00100000:3.0:1788664167.509059:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161280 00000100:00100000:3.0:1788664167.509060:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161280 00000100:00100000:3.0:1788664167.509073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664167.509081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5847:x1875550222161024:12345-0@lo:104: 00010000:00010000:3.0:1788664167.509094:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.509214:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664167.509220:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5847:x1875550222161024:12345-0@lo:104: Request processed in 141us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.509245:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664167.509262:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664167.509269:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:5847:x1875550222161152:12345-0@lo:104: 00010000:00010000:3.0:1788664167.509277:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.509372:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5847:1875550222161024:0@lo:104: 00000100:00100000:0.0:1788664167.509382:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5847:1875550222161152:0@lo:104: 00010000:00010000:1.0:1788664167.509544:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664167.509553:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.509561:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664167.509565:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.509575:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664167.509583:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664167.509590:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664167.509704:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.509712:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664167.509736:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.509743:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be8ff04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff0b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.509757:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664167.509761:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.509774:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215b800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664167.509777:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.509784:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664167.509790:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664167.509795:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788664167.509829:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222161408:0@lo:103: 00000100:00100000:2.0:1788664167.509866:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.509916:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161408 00000100:00100000:2.0:1788664167.509922:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161408 00010000:00010000:2.0:1788664167.509942:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b690215a000/0x762f55027be8ff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff04 expref: 13 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.509967:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664167.509974:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3307:x1875550222161408:12345-0@lo:103: 00010000:00010000:2.0:1788664167.509984:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664167.509989:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b690215a000/0x762f55027be8ff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff04 expref: 13 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.510000:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b690215a000/0x762f55027be8ff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ff04 expref: 13 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.510026:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215a000/0x762f55027be8ff0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ff04 expref: 13 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.510039:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664167.510066:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3307:x1875550222161408:12345-0@lo:103: Request processed in 93us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.510072:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664167.510111:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222161408:0@lo:103: 00010000:00010000:3.0:1788664167.510266:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788664167.510275:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:5847:x1875550222161152:12345-0@lo:104: Request processed in 1005us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.510282:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664167.510297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664167.510304:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5847:x1875550222161280:12345-0@lo:104: 00010000:00010000:3.0:1788664167.510313:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.510373:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664167.510378:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5847:x1875550222161280:12345-0@lo:104: Request processed in 76us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.510384:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664167.510410:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3415500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5847:1875550222161280:0@lo:104: 00010000:00010000:3.0:1788664167.510433:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.510539:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664167.510861:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664167.510864:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664167.510865:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664167.510894:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.510902:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c0030400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1788664167.510910:0:5843:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.510918:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664167.510925:0:5843:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664167.510930:0:5843:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664167.510963:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.510970:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664167.510986:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.510994:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c0030400/0x762f55027be8fe78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fe7f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.511005:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664167.511007:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664167.511008:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664167.511136:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664167.511158:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222161536:0@lo:103: 00000100:00100000:2.0:1788664167.511192:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.511269:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161536 00000100:00100000:0.0:1788664167.511274:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161536 00010000:00010000:0.0:1788664167.511294:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c1479800/0x762f55027be8fe7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fe78 expref: 12 pid: 5848 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.511321:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664167.511328:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3307:x1875550222161536:12345-0@lo:103: 00010000:00010000:0.0:1788664167.511337:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664167.511365:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c1479800/0x762f55027be8fe7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fe78 expref: 12 pid: 5848 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.511374:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c1479800/0x762f55027be8fe7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8fe78 expref: 12 pid: 5848 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.511386:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479800/0x762f55027be8fe7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8fe78 expref: 12 pid: 5848 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.511412:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664167.511445:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3307:x1875550222161536:12345-0@lo:103: Request processed in 118us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.511452:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664167.511480:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222161536:0@lo:103: 00010000:00010000:1.0:1788664167.512002:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512010:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664167.512043:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512051:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8fe94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fe9b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512068:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664167.512070:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664167.512072:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664167.512169:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664167.512181:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222161664:0@lo:103: 00000100:00100000:3.0:1788664167.512215:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.512311:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161664 00000100:00100000:1.0:1788664167.512317:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161664 00010000:00010000:1.0:1788664167.512336:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c0030600/0x762f55027be8fe9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fe94 expref: 11 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664167.512398:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664167.512415:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3310:x1875550222161664:12345-0@lo:103: 00010000:00010000:1.0:1788664167.512424:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664167.512430:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c0030600/0x762f55027be8fe9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fe94 expref: 11 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512439:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c0030600/0x762f55027be8fe9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8fe94 expref: 11 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512452:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c0030600/0x762f55027be8fe9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8fe94 expref: 11 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512466:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512475:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512488:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512495:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512501:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512508:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512514:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efe00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664167.512519:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512534:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512546:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.512556:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664167.512587:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:3310:x1875550222161664:12345-0@lo:103: Request processed in 174us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.512594:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664167.512669:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222161664:0@lo:103: 00010000:00010000:3.0:1788664167.512693:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.512700:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.512713:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66efe00/0x762f55027be8ff66 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664167.512728:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788664167.563835:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:6692:x1875550222160896:12345-0@lo:253: Request processed in 63048us (63407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.563852:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788664167.563978:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222160896:0@lo:253: 10000000:01000000:3.0:1788664167.563997:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788664167.564000:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664167.564002:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664167.564004:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664167.564005:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788664167.564006:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664167.564007:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664167.564079:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664167.564082:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788664167.564083:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664167.564084:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788664167.564108:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b68f8b62000 from lustre-OST0000 10000000:01000000:3.0:1788664167.564147:0:6692:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788664167.564150:0:6692:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788664167.564159:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b68c3f919c0 local copy 10000000:01000000:3.0:1788664167.564163:0:6692:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788664167.564202:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.564214:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.564223:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.564241:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222161792:0@lo:101: 00000100:00100000:3.0:1788664167.564305:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.564389:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c91dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.564532:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161792 00000100:00100000:1.0:1788664167.564541:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161792 00000100:00100000:1.0:1788664167.564585:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664167.564594:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:6692:x1875550222161792:12345-0@lo:101: 00010000:00010000:1.0:1788664167.564606:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664167.564620:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1478600/0x762f55027be8ff74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ff6d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.564642:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1478600/0x762f55027be8ff74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ff6d expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.564653:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1478600/0x762f55027be8ff74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff6d expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.564663:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478600, rc 0) 00000100:00100000:1.0:1788664167.564705:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:6692:x1875550222161792:12345-0@lo:101: Request processed in 112us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.564711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788664167.564796:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222161792:0@lo:101: 00010000:00010000:0.0:1788664167.564810:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.564819:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.564918:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222161920:0@lo:501: 00000100:00100000:0.0:1788664167.564946:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.564971:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.565091:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222161920 00000100:00100000:1.0:1788664167.565096:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222161920 00000100:00100000:1.0:1788664167.565137:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788664167.565144:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:6692:x1875550222161920:12345-0@lo:501: 00000100:00100000:1.0:1788664167.565398:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:6692:x1875550222161920:12345-0@lo:501: Request processed in 253us (450us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788664167.565406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788664167.565507:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222161920:0@lo:501: 10000000:01000000:0.0:1788664167.565521:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788664167.565550:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788664167.565555:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.565564:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.565578:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.565601:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788664167.565621:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b68f8b62000 10000000:01000000:0.0:1788664167.565626:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788664167.565631:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b68c3f919c0 10000000:01000000:0.0:1788664167.565633:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788664167.565636:0:6692:0:(mgc_request.c:1800:mgc_process_log()) Process log nodemap-ffff9b68c3f919c0 from 1 10000000:01000000:0.0:1788664167.565639:0:6692:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788664167.565659:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.565667:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.565675:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.565688:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162048:0@lo:101: 00000100:00100000:0.0:1788664167.565729:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.565749:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f250c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.566098:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162048 00000100:00100000:1.0:1788664167.566103:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162048 00000100:00100000:1.0:1788664167.566231:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788664167.566241:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+10:6692:x1875550222162048:12345-0@lo:101: 00010000:00010000:1.0:1788664167.566251:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664167.566272:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1478400/0x762f55027be8ff82 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ff7b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.566290:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1478400/0x762f55027be8ff82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ff7b expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.566299:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1478400/0x762f55027be8ff82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff7b expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.566307:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478400, rc 0) 00000100:00100000:1.0:1788664167.566367:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:6692:x1875550222162048:12345-0@lo:101: Request processed in 128us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.566373:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788664167.566489:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162048:0@lo:101: 00010000:00010000:0.0:1788664167.566503:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff82 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566511:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ff82 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664167.566539:0:6692:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788664167.566549:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff82 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566556:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff82 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664167.566562:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788664167.566566:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664167.566570:0:6692:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788664167.566572:0:6692:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788664167.566589:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566596:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566603:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.566616:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162176:0@lo:101: 00000100:00100000:0.0:1788664167.566644:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.566666:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.566687:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162176 00000100:00100000:0.0:1788664167.566691:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162176 00000100:00100000:0.0:1788664167.566711:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788664167.566717:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:6692:x1875550222162176:12345-0@lo:101: 00010000:00010000:0.0:1788664167.566724:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664167.566737:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ff89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566751:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ff89 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566759:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff89 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566766:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66eea00, rc 0) 00000100:00100000:0.0:1788664167.566794:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162176:12345-0@lo:101: Request processed in 76us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.566800:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788664167.566829:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162176:0@lo:101: 00010000:00010000:0.0:1788664167.566840:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.566846:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.566918:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162304:0@lo:501: 00000100:00100000:0.0:1788664167.566942:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.566955:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.566966:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162304 00000100:00100000:0.0:1788664167.566970:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162304 00000100:00100000:0.0:1788664167.567001:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664167.567007:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162304:12345-0@lo:501: 00000100:00100000:0.0:1788664167.567531:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162304:12345-0@lo:501: Request processed in 522us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.567546:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664167.567631:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162304:0@lo:501: 00000100:00100000:2.0:1788664167.567663:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162432:0@lo:503: 00000100:00100000:2.0:1788664167.567704:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.567735:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.567789:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162432 00000100:00100000:3.0:1788664167.567794:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162432 00000100:00100000:3.0:1788664167.567829:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788664167.567836:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162432:12345-0@lo:503: 00000100:00100000:3.0:1788664167.567994:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162432:12345-0@lo:503: Request processed in 157us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.568000:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788664167.568125:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162432:0@lo:503: 00000040:00080000:2.0:1788664167.568447:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788664167.568529:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162560:0@lo:502: 00000100:00100000:2.0:1788664167.568567:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.568580:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.568717:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162560 00000100:00100000:3.0:1788664167.568722:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162560 00000100:00100000:3.0:1788664167.568740:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788664167.568747:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162560:12345-0@lo:502: 00000100:00100000:3.0:1788664167.568901:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162560:12345-0@lo:502: Request processed in 154us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.568908:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788664167.569284:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162560:0@lo:502: 00000040:00080000:2.0:1788664167.569582:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788664167.569632:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788664167.569662:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788664167.569708:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788664167.569745:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788664167.569781:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788664167.569810:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162688:0@lo:502: 00000100:00100000:2.0:1788664167.569850:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664167.569878:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664167.570066:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162688 00000100:00100000:3.0:1788664167.570072:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162688 00000100:00100000:3.0:1788664167.570100:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788664167.570107:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162688:12345-0@lo:502: 00000100:00100000:3.0:1788664167.570279:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162688:12345-0@lo:502: Request processed in 171us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.570286:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664167.570482:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162688:0@lo:502: 00000040:00080000:2.0:1788664167.570575:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788664167.570586:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:1.0:1788664167.571000:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664167.571118:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.571142:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664167.571146:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.571157:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664167.571164:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664167.571170:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664167.571200:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.571207:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664167.571243:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.571251:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c147b800/0x762f55027be8ff6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x762f55027be8ff74 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.571357:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664167.571373:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222162816:0@lo:103: 00000100:00100000:0.0:1788664167.571420:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.571469:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162816 00000100:00100000:0.0:1788664167.571474:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162816 00000100:00100000:0.0:1788664167.571519:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664167.571528:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3309:x1875550222162816:12345-0@lo:103: 00010000:00010000:0.0:1788664167.571540:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664167.571554:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1478600/0x762f55027be8ff74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be8ff6d expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.571568:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664167.571599:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:3309:x1875550222162816:12345-0@lo:103: Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.571605:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664167.571640:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222162816:0@lo:103: 00010000:00010000:1.0:1788664167.571748:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664167.571751:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664167.571753:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788664167.572087:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788664167.572094:0:6713:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788664167.572102:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664167.572104:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788664167.572121:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664167.572138:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b68c8fe3380) 00000020:00000080:2.0:1788664167.572158:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788664167.572164:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788664167.572326:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68f8b62000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788664167.572337:0:6713:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788664167.572504:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x762f55027be8ff9e 00010000:00010000:2.0:1788664167.576769:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788664167.577193:0:6713:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788664167.580610:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788664167.580915:0:6713:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788664167.589590:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788664167.590159:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788664167.592095:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788664167.592116:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664167.592124:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664167.592126:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788664167.592130:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664167.592134:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664167.592144:0:6713:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788664167.592148:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788664167.592150:0:6713:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788664167.592207:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664167.592212:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664167.592213:0:6713:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788664167.592217:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788664167.592540:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788664167.593089:0:6692:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788664167.593163:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.593177:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664167.593186:0:6692:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68f8b62000 from 1 10000000:01000000:0.0:1788664167.593190:0:6692:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664167.593243:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.593252:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.593274:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.593300:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162944:0@lo:101: 00000100:00100000:0.0:1788664167.593404:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.593465:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.593566:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222162944 00000100:00100000:2.0:1788664167.593574:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222162944 00000100:00100000:2.0:1788664167.593619:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664167.593628:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:6692:x1875550222162944:12345-0@lo:101: 00010000:00010000:2.0:1788664167.593642:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664167.593667:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ffa5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.593692:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.593713:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.593730:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215a000, rc 0) 00000100:00100000:2.0:1788664167.593770:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222162944:12345-0@lo:101: Request processed in 143us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.593776:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788664167.598011:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222162944:0@lo:101: 00010000:00010000:0.0:1788664167.598043:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.598057:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.598199:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163072:0@lo:501: 00000100:00100000:0.0:1788664167.598268:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.598311:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.598335:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163072 00000100:00100000:0.0:1788664167.598362:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163072 00000100:00100000:0.0:1788664167.598404:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788664167.598413:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163072:12345-0@lo:501: 00000100:00100000:0.0:1788664167.598665:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163072:12345-0@lo:501: Request processed in 252us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.598673:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788664167.598725:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163072:0@lo:501: 00000100:00100000:0.0:1788664167.598750:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163200:0@lo:503: 00000100:00100000:0.0:1788664167.598787:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.598800:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.598811:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163200 00000100:00100000:0.0:1788664167.598815:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163200 00000100:00100000:0.0:1788664167.598836:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788664167.598842:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163200:12345-0@lo:503: 00000100:00100000:0.0:1788664167.599005:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163200:12345-0@lo:503: Request processed in 162us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.599012:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788664167.599049:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163200:0@lo:503: 00000040:00080000:0.0:1788664167.599358:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664167.599422:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163328:0@lo:502: 00000100:00100000:0.0:1788664167.599459:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.599475:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.599489:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163328 00000100:00100000:0.0:1788664167.599494:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163328 00000100:00100000:0.0:1788664167.599515:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788664167.599522:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163328:12345-0@lo:502: 00000100:00100000:0.0:1788664167.599646:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163328:12345-0@lo:502: Request processed in 123us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.599653:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788664167.599691:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163328:0@lo:502: 00000040:00080000:0.0:1788664167.599910:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788664167.599956:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788664167.599982:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163456:0@lo:502: 00000100:00100000:0.0:1788664167.600013:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.600028:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664167.600041:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163456 00000100:00100000:0.0:1788664167.600044:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163456 00000100:00100000:0.0:1788664167.600065:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788664167.600071:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163456:12345-0@lo:502: 00000100:00100000:0.0:1788664167.600189:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163456:12345-0@lo:502: Request processed in 117us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664167.600196:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788664167.600234:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163456:0@lo:502: 00000040:00080000:0.0:1788664167.600303:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788664167.600311:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788664167.603144:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664167.603158:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664167.603168:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788664167.603175:0:6717:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68f8b62000 00000020:00000080:3.0:1788664167.603178:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664167.603201:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664167.603204:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664167.603206:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788664167.603209:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788664167.603490:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788664167.603515:0:6692:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664167.603566:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.603579:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664167.603624:0:6692:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788664167.603627:0:6692:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff9b68f8b62000 10000000:01000000:0.0:1788664167.603631:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b68f8b62000 10000000:01000000:0.0:1788664167.603636:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664167.603642:0:6692:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68f8b62000 from 1 10000000:01000000:0.0:1788664167.603645:0:6692:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664167.603681:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.603701:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.603713:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.603735:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163584:0@lo:101: 00000100:00100000:0.0:1788664167.603802:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.603845:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.603904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163584 00000100:00100000:2.0:1788664167.603911:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163584 00000100:00100000:2.0:1788664167.603956:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788664167.603964:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222163584:12345-0@lo:101: 00010000:00010000:2.0:1788664167.603978:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664167.603990:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ffb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.604011:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.604021:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664167.604030:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215a600, rc 0) 00000100:00100000:2.0:1788664167.604123:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222163584:12345-0@lo:101: Request processed in 159us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.604129:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788664167.604244:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163584:0@lo:101: 00010000:00010000:3.0:1788664167.604259:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.604269:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.604486:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163712:0@lo:501: 00000100:00100000:3.0:1788664167.604515:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.604572:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8876c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.604604:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163712 00000100:00100000:1.0:1788664167.604608:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163712 00000100:00100000:1.0:1788664167.604664:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788664167.604672:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222163712:12345-0@lo:501: 00000100:00100000:1.0:1788664167.604883:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222163712:12345-0@lo:501: Request processed in 212us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.604889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788664167.604945:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163712:0@lo:501: 00000100:00100000:3.0:1788664167.604968:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163840:0@lo:503: 00000100:00100000:3.0:1788664167.605011:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.605076:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8876c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.605145:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163840 00000100:00100000:2.0:1788664167.605149:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163840 00000100:00100000:2.0:1788664167.605166:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788664167.605171:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222163840:12345-0@lo:503: 00000100:00100000:2.0:1788664167.605320:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222163840:12345-0@lo:503: Request processed in 147us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.605332:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788664167.605432:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163840:0@lo:503: 00000040:00080000:3.0:1788664167.605692:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664167.605757:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163968:0@lo:502: 00000100:00100000:3.0:1788664167.605790:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.605816:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.605853:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222163968 00000100:00100000:2.0:1788664167.605857:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222163968 00000100:00100000:2.0:1788664167.605874:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788664167.605880:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222163968:12345-0@lo:502: 00000100:00100000:2.0:1788664167.606059:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222163968:12345-0@lo:502: Request processed in 178us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.606066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788664167.606265:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222163968:0@lo:502: 00000040:00080000:3.0:1788664167.606757:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788664167.606807:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788664167.606837:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788664167.606879:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788664167.606914:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788664167.606961:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788664167.606993:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788664167.607027:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788664167.607077:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788664167.607126:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788664167.607166:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788664167.607228:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788664167.607268:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788664167.607304:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788664167.607431:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788664167.607468:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788664167.607501:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788664167.607545:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788664167.607582:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788664167.607615:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788664167.607945:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788664167.607986:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788664167.608020:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788664167.608065:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788664167.608099:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788664167.608145:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788664167.608187:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788664167.608221:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788664167.608270:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222164096:0@lo:502: 00000100:00100000:3.0:1788664167.608463:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.608545:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664167.608589:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164096 00000100:00100000:2.0:1788664167.608597:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164096 00000100:00100000:2.0:1788664167.608675:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788664167.608684:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222164096:12345-0@lo:502: 00000100:00100000:2.0:1788664167.608906:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222164096:12345-0@lo:502: Request processed in 222us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.608914:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664167.608992:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222164096:0@lo:502: 00000040:00080000:3.0:1788664167.609072:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788664167.609083:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788664167.610516:0:6718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788664167.610534:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b68c3f90000) 00000020:00000080:0.0:1788664167.610555:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788664167.610625:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68f8b62000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788664167.610629:0:6718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68f8b62000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788664167.610631:0:6718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68f8b62000 3 00010000:00080000:0.0:1788664167.610664:0:6718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b67c536e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.114@tcp at head 00010000:00010000:0.0:1788664167.615173:0:6718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788664167.615474:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788664167.615522:0:6718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788664167.615542:0:6718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x762f55027be8ffc8 00000100:00080000:0.0:1788664167.615557:0:6718:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664167.615565:0:6718:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b67c536e800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788664167.618068:0:6718:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68c3415c00 x1875550222164224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664167.618119:0:6718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788664167.618358:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875550222164224:0@lo:38: 00000100:00100000:1.0:1788664167.618454:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664167.618573:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164224 00000100:00100000:0.0:1788664167.618576:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222164352:0@lo:400: 00000100:00100000:1.0:1788664167.618585:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164224 00000100:00100000:1.0:1788664167.618628:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664167.618635:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875550222164224:12345-0@lo:38: 00010000:00080000:1.0:1788664167.618687:0:5856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1788664167.618725:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x762f55027be8ffcf 00000004:00100000:1.0:1788664167.618741:0:5856:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788664167.618774:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9b68df62b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664167.618827:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875550222164224:12345-0@lo:38: Request processed in 191us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.618836:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788664167.618879:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b68c3415c00 x1875550222164224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664167.618903:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664167.618911:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788664167.618919:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788664167.618925:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664167.618928:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b67c536e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664167.618934:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875550222164224:0@lo:38: 00000100:00100000:0.0:1788664167.621292:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788664167.621668:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788664167.622581:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788664167.622624:0:6692:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788664167.622655:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.622669:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788664167.622722:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788664167.622725:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664167.622727:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664167.622728:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664167.622729:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664167.622731:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664167.622732:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664167.622734:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664167.622736:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664167.622737:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664167.622739:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788664167.622743:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788664167.622746:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788664167.622747:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664167.622748:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664167.622749:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664167.622750:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664167.622751:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664167.622752:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664167.622754:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664167.622755:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664167.622756:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664167.622757:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788664167.622785:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788664167.622804:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222164480:0@lo:253: 00000100:00100000:3.0:1788664167.622884:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.622921:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.623011:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164352 00000100:00100000:1.0:1788664167.623020:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164352 00000100:00100000:0.0:1788664167.623081:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164480 00000100:00100000:1.0:1788664167.623090:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664167.623095:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164480 00000100:00100000:1.0:1788664167.623113:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222164352:12345-0@lo:400: 00000100:00100000:0.0:1788664167.623164:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788664167.623178:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6692:x1875550222164480:12345-0@lo:253: 00000100:00100000:1.0:1788664167.623197:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3415f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222164352:12345-0@lo:400: Request processed in 96us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.623209:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:0.0:1788664167.623217:0:5849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788664167.623237:0:5849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788664167.625138:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b68c3417480 x1875550222164352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664167.625164:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222164352:0@lo:400: 20000000:01000000:3.0:1788664167.685548:0:5849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788664167.685678:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788664167.693702:0:5870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788664167.693720:0:5870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788664167.693978:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.694004:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c0031a00/0x762f55027be8ff35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff2e expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.694015:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.694082:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c0031a00/0x762f55027be8ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ff2e expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.694112:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c0031a00/0x762f55027be8ff35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ff2e expref: 13 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664167.694130:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5870:1875550222164608:0@lo:104: 00000100:00100000:0.0:1788664167.694222:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664167.694313:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c581be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664167.694472:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164608 00000100:00100000:1.0:1788664167.694483:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164608 00000100:00100000:1.0:1788664167.694548:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664167.694560:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5870:x1875550222164608:12345-0@lo:104: 00010000:00010000:1.0:1788664167.694576:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664167.694643:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664167.694649:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5870:x1875550222164608:12345-0@lo:104: Request processed in 93us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664167.694658:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664167.694669:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5870:1875550222164608:0@lo:104: 00010000:00010000:3.0:1788664167.694796:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664167.694804:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.694812:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1788664167.694817:0:5843:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.694827:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664167.694845:0:5843:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664167.694852:0:5843:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664167.694896:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.694903:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664167.694929:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.694937:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be8ff2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff35 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.694957:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664167.694960:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664167.694968:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664167.694984:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222164736:0@lo:103: 00000100:00100000:3.0:1788664167.695021:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664167.695112:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164736 00000100:00100000:3.0:1788664167.695118:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164736 00010000:00010000:3.0:1788664167.695138:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c0031a00/0x762f55027be8ff35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff2e expref: 14 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664167.695163:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664167.695170:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5890450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:3308:x1875550222164736:12345-0@lo:103: 00010000:00010000:3.0:1788664167.695182:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664167.695188:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c0031a00/0x762f55027be8ff35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff2e expref: 14 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695199:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c0031a00/0x762f55027be8ff35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ff2e expref: 14 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695214:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c0031a00/0x762f55027be8ff35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ff2e expref: 14 pid: 5847 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695230:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695240:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664167.695572:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001852694s 00010000:00010000:3.0:1788664167.695578:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695586:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695600:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695607:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695613:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664167.695618:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695626:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695636:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664167.695646:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664167.695684:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5890450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3308:x1875550222164736:12345-0@lo:103: Request processed in 514us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664167.695692:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664167.695777:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222164736:0@lo:103: 00010000:00010000:0.0:1788664167.696158:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.696173:0:5870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.696182:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664167.696189:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ef800/0x762f55027be8ffd6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664167.705129:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:6692:x1875550222164480:12345-0@lo:253: Request processed in 81939us (82228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664167.705149:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788664167.705296:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:6692:1875550222164480:0@lo:253: 10000000:01000000:3.0:1788664167.705318:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788664167.705322:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664167.705324:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664167.705326:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664167.705327:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664167.705328:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664167.705330:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664167.705396:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664167.705399:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788664167.705400:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788664167.705402:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664167.705404:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788664167.705427:0:6692:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788664167.720330:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664167.721297:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788664167.721591:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664167.721764:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788664167.722733:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664167.723052:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788664167.724310:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788664168.096128:0:6692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788664168.096140:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788664168.096180:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788664168.101608:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788664168.101852:0:6692:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788664168.101891:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788664168.224574:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664169.249690:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664170.283601:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664171.301953:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664172.327793:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664172.835866:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222164992:0@lo:400: 00000100:00100000:3.0:1788664172.835944:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664172.835999:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664172.836006:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222164864:0@lo:400: 00000100:00100000:3.0:1788664172.836035:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664172.836076:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222165120:0@lo:400: 00000100:00100000:3.0:1788664172.836104:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664172.836144:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164992 00000100:00100000:3.0:1788664172.836152:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164992 00000100:00100000:3.0:1788664172.836196:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222165120 00000100:00100000:3.0:1788664172.836199:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222165120 00000100:00100000:3.0:1788664172.836233:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664172.836241:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222164992:12345-0@lo:400: 00000100:00100000:3.0:1788664172.836293:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222164992:12345-0@lo:400: Request processed in 52us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664172.836300:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664172.836331:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664172.836337:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222165120:12345-0@lo:400: 00000100:00100000:3.0:1788664172.836395:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222165120:12345-0@lo:400: Request processed in 57us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664172.836417:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664172.836637:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222164864 00000100:00100000:2.0:1788664172.836642:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222164864 00000100:00100000:2.0:1788664172.836675:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788664172.836682:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3310:x1875550222164864:12345-0@lo:400: 00000100:00100000:2.0:1788664172.836720:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3310:x1875550222164864:12345-0@lo:400: Request processed in 39us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664172.836737:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788664172.836795:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222164864:0@lo:400: 00010000:00080000:2.0:1788664172.836812:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9022a00 x1875550222164992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664172.836825:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222164992:0@lo:400: 00010000:00080000:3.0:1788664172.836909:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9020a80 x1875550222165120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664172.836919:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222165120:0@lo:400: 00000100:00080000:3.0:1788664172.836948:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1788664173.345363:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788664173.345371:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68d438d000 from 21 10000000:01000000:2.0:1788664173.345377:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664173.345418:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.345430:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.345440:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664173.345465:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165248:0@lo:101: 00000100:00100000:2.0:1788664173.345530:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.345596:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664173.345657:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222165248 00000100:00100000:1.0:1788664173.345667:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222165248 00010000:00010000:3.0:1788664173.345730:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664173.345734:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664173.345746:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222165248:12345-0@lo:101: 00010000:00010000:1.0:1788664173.345761:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664173.345775:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ffdd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664173.345800:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ffdd expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664173.345815:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffdd expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664173.345824:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479000, rc 0) 00000100:00100000:1.0:1788664173.345874:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222165248:12345-0@lo:101: Request processed in 130us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664173.345881:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788664173.346034:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165248:0@lo:101: 00010000:00010000:2.0:1788664173.346050:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.346060:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664173.346132:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165376:0@lo:501: 00000100:00100000:2.0:1788664173.346159:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.346183:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664173.346219:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222165376 00000100:00100000:1.0:1788664173.346223:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222165376 00000100:00100000:1.0:1788664173.346255:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788664173.346263:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222165376:12345-0@lo:501: 00000100:00100000:1.0:1788664173.346627:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222165376:12345-0@lo:501: Request processed in 365us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664173.346635:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788664173.346812:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165376:0@lo:501: 00000100:00100000:2.0:1788664173.346839:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165504:0@lo:503: 00000100:00100000:2.0:1788664173.346877:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.346908:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664173.347219:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222165504 00000100:00100000:1.0:1788664173.347235:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222165504 00000100:00100000:1.0:1788664173.347403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788664173.347412:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222165504:12345-0@lo:503: 00000100:00100000:1.0:1788664173.348010:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222165504:12345-0@lo:503: Request processed in 596us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664173.348019:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664173.348212:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165504:0@lo:503: 00000100:00100000:3.0:1788664173.348452:0:6965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6965:1875550222165632:0@lo:502: 00000100:00100000:3.0:1788664173.348493:0:6965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664173.350087:0:6965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664173.350101:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222165632 00000100:00100000:2.0:1788664173.350112:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222165632 00000100:00100000:2.0:1788664173.350165:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788664173.350174:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6965:x1875550222165632:12345-0@lo:502: 00000100:00100000:2.0:1788664173.350663:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6965:x1875550222165632:12345-0@lo:502: Request processed in 491us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664173.350672:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788664173.354364:0:6965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6965:1875550222165632:0@lo:502: 00000100:00100000:3.0:1788664173.354449:0:6965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6965:1875550222165760:0@lo:502: 00000100:00100000:3.0:1788664173.354523:0:6965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664173.354570:0:6965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788664173.354699:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222165760 00000100:00100000:1.0:1788664173.354707:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222165760 00000100:00100000:1.0:1788664173.354763:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788664173.354773:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6965:x1875550222165760:12345-0@lo:502: 00000100:00100000:1.0:1788664173.355020:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:6965:x1875550222165760:12345-0@lo:502: Request processed in 248us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664173.355029:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788664173.355912:0:6965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6965:1875550222165760:0@lo:502: 00000040:00080000:3.0:1788664173.355945:0:6965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788664173.356050:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788664173.356080:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664173.356092:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.356105:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664173.356117:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664173.356119:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68d438d000 from 4 10000000:01000000:2.0:1788664173.356122:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664173.356157:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.356174:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.356183:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664173.356557:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165888:0@lo:101: 00000100:00100000:2.0:1788664173.356622:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.356663:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664173.357139:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222165888 00000100:00100000:3.0:1788664173.357147:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222165888 00000100:00100000:3.0:1788664173.357196:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788664173.357205:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222165888:12345-0@lo:101: 00010000:00010000:3.0:1788664173.357220:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664173.357237:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8ffeb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664173.357262:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8ffeb expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664173.357281:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffeb expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664173.357290:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b400, rc 0) 00000100:00100000:3.0:1788664173.357333:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222165888:12345-0@lo:101: Request processed in 129us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664173.357358:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788664173.357836:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222165888:0@lo:101: 00010000:00010000:2.0:1788664173.357853:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.357864:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664173.357920:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166016:0@lo:256: 00000100:00100000:2.0:1788664173.357954:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.357988:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664173.358005:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166016 00000100:00100000:2.0:1788664173.358009:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166016 00000100:00100000:2.0:1788664173.358044:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664173.358050:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222166016:12345-0@lo:256: 20000000:01000000:2.0:1788664173.358067:0:5847:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788664173.358083:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788664173.358087:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788664173.358158:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222166016:12345-0@lo:256: Request processed in 107us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664173.358169:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664173.358308:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166016:0@lo:256: 10000000:01000000:2.0:1788664173.358519:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664173.358528:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.358538:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664173.358547:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788664173.358550:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788664173.358553:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664173.358574:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.358592:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.358601:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664173.358614:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166144:0@lo:101: 00000100:00100000:2.0:1788664173.358643:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.358665:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664173.358677:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166144 00000100:00100000:2.0:1788664173.358681:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166144 00000100:00100000:2.0:1788664173.358771:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664173.358779:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222166144:12345-0@lo:101: 00010000:00010000:2.0:1788664173.358796:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664173.358808:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be8fff9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.358826:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be8fff9 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.358836:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fff9 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.358844:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215ac00, rc 0) 00000100:00100000:2.0:1788664173.358876:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222166144:12345-0@lo:101: Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664173.358882:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664173.358912:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166144:0@lo:101: 00010000:00010000:2.0:1788664173.358924:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664173.358932:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664173.358975:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166272:0@lo:501: 00000100:00100000:2.0:1788664173.358998:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.359010:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664173.359021:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166272 00000100:00100000:2.0:1788664173.359024:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166272 00000100:00100000:2.0:1788664173.359040:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664173.359046:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222166272:12345-0@lo:501: 00000100:00100000:2.0:1788664173.359616:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222166272:12345-0@lo:501: Request processed in 569us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664173.359624:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664173.359674:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166272:0@lo:501: 00000100:00100000:2.0:1788664173.359784:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166400:0@lo:503: 00000100:00100000:2.0:1788664173.359825:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.359851:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664173.359862:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166400 00000100:00100000:2.0:1788664173.359866:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166400 00000100:00100000:2.0:1788664173.359888:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788664173.359895:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222166400:12345-0@lo:503: 00000100:00100000:2.0:1788664173.360784:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222166400:12345-0@lo:503: Request processed in 885us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664173.360793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788664173.363881:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222166400:0@lo:503: 00000100:00100000:1.0:1788664173.368643:0:6966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6966:1875550222166528:0@lo:502: 00000100:00100000:1.0:1788664173.369458:0:6966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664173.369982:0:6966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59a6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664173.372378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166528 00000100:00100000:3.0:1788664173.372394:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166528 00000100:00100000:3.0:1788664173.372455:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788664173.372465:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:6966:x1875550222166528:12345-0@lo:502: 00000100:00100000:3.0:1788664173.373040:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:6966:x1875550222166528:12345-0@lo:502: Request processed in 575us (3581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664173.373049:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664173.373204:0:6966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6966:1875550222166528:0@lo:502: 00000020:01000000:1.0:1788664173.373245:0:6966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788664173.373253:0:6966:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788664173.373261:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664173.373263:0:6966:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788664173.373269:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788664173.373272:0:6966:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:1.0:1788664173.373298:0:6966:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788664173.373301:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664173.373329:0:6966:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b68f818cd40) 00000020:00000080:1.0:1788664173.373389:0:6966:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788664173.373396:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788664173.373503:0:6966:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788664173.373509:0:6966:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788664173.373517:0:6966:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be9000e 00010000:00080000:1.0:1788664173.373544:0:6966:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b68f808b000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788664173.373911:0:6966:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788664173.440651:0:6966:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788664173.440675:0:6966:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788664173.441170:0:6966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664173.441540:0:6966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664173.441599:0:6966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788664173.441654:0:6966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788664173.442480:0:6970:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664173.442486:0:6970:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788664173.443287:0:6966:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788664173.443300:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788664173.443334:0:6966:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788664173.443382:0:6966:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be90015 00000100:00080000:0.0:1788664173.443394:0:6966:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788664173.443402:0:6966:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b68f808b000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:0.0:1788664173.443439:0:6966:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68c3417480 x1875550222166656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788664173.443470:0:6966:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788664173.443532:0:6966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664173.443536:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664173.443538:0:6966:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788664173.443541:0:6966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664173.443545:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664173.443547:0:6966:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788664173.443550:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788664173.443552:0:6966:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788664173.443593:0:6966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6966:1875550222166784:0@lo:502: 00000100:00100000:0.0:1788664173.443673:0:6966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.443868:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222166656:0@lo:8: 00000100:00100000:2.0:1788664173.443910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664173.443957:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166656 00000100:00100000:1.0:1788664173.443974:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166656 00000100:00100000:1.0:1788664173.444011:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664173.444018:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875550222166656:12345-0@lo:8: 00010000:00080000:1.0:1788664173.444040:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000100:00100000:3.0:1788664173.444050:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222166912:0@lo:400: 00000020:00000080:1.0:1788664173.444060:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be9001c 00000100:00100000:3.0:1788664173.444090:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1788664173.444091:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b68f808a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788664173.444096:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788664173.444099:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788664173.444126:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166912 00000100:00100000:3.0:1788664173.444131:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166912 00000100:00100000:3.0:1788664173.444164:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664173.444170:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222166912:12345-0@lo:400: 00000100:00100000:3.0:1788664173.444217:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222166912:12345-0@lo:400: Request processed in 47us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664173.444224:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664173.444302:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222167040:0@lo:400: 00000100:00100000:2.0:1788664173.444332:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664173.444424:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167040 00000100:00100000:3.0:1788664173.444429:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167040 00000100:00100000:3.0:1788664173.444459:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664173.444474:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222167040:12345-0@lo:400: 00000100:00100000:3.0:1788664173.444511:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222167040:12345-0@lo:400: Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664173.444517:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664173.444924:0:6966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664173.444945:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222166784 00000100:00100000:0.0:1788664173.444949:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222166784 00000100:00100000:0.0:1788664173.444980:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788664173.444988:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:6966:x1875550222166784:12345-0@lo:502: 00002000:00100000:1.0:1788664173.445127:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788664173.445285:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:6966:x1875550222166784:12345-0@lo:502: Request processed in 296us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664173.445293:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00002000:00080000:1.0:1788664173.445359:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788664173.445377:0:6966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:6966:1875550222166784:0@lo:502: 00000100:00080000:1.0:1788664173.445389:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b68f808f800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1788664173.445408:0:6966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664173.445416:0:6966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664173.445418:0:6966:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788664173.445423:0:6966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788664173.445440:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875550222166656:12345-0@lo:8: Request processed in 1419us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664173.445449:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:0.0:1788664173.445546:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788664173.445599:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788664173.445610:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.445632:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664173.445642:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788664173.445645:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff9b68c3f919c0 from 1 10000000:01000000:0.0:1788664173.445648:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788664173.445676:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.445683:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.445692:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664173.445719:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222167168:0@lo:101: 00010000:00080000:3.0:1788664173.446924:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68c3417480 x1875550222166656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664173.446938:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788664173.446948:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788664173.446957:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788664173.446963:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788664173.446965:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f808b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788664173.446980:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788664173.446986:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222166656:0@lo:8: 00010000:00080000:3.0:1788664173.447043:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9020a80 x1875550222166912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664173.447054:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222166912:0@lo:400: 00010000:00080000:2.0:1788664173.447854:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9021500 x1875550222167040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664173.447866:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222167040:0@lo:400: 00000004:00080000:2.0:1788664173.447918:0:6970:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788664173.448033:0:6970:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 207431690735ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788664173.450730:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664173.450776:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664173.450808:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167168 00000100:00100000:0.0:1788664173.450816:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167168 00000100:00100000:0.0:1788664173.450859:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788664173.450867:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222167168:12345-0@lo:101: 00010000:00010000:0.0:1788664173.450883:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664173.450902:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be90023 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.450930:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be90023 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.450958:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90023 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.450967:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66eee00, rc 0) 00000100:00100000:0.0:1788664173.451008:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222167168:12345-0@lo:101: Request processed in 141us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664173.451015:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788664173.451061:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222167168:0@lo:101: 00010000:00010000:0.0:1788664173.451077:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.451086:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664173.451149:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222167296:0@lo:501: 00000100:00100000:0.0:1788664173.451175:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664173.451189:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664173.451202:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167296 00000100:00100000:0.0:1788664173.451206:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167296 00000100:00100000:0.0:1788664173.451223:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664173.451229:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222167296:12345-0@lo:501: 00000100:00100000:0.0:1788664173.451648:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222167296:12345-0@lo:501: Request processed in 417us (470us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664173.451656:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664173.451694:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222167296:0@lo:501: 10000000:01000000:0.0:1788664173.451721:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788664173.451734:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664173.451742:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664173.529048:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788664173.529140:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222167424:0@lo:13: 00000100:00100000:2.0:1788664173.529214:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.529312:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167424 00000100:00100000:2.0:1788664173.529320:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167424 00000100:00100000:2.0:1788664173.529398:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664173.529408:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222167424:12345-0@lo:13: 00002000:00000024:2.0:1788664173.529443:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788664173.529489:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222167424:12345-0@lo:13: Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664173.529497:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788664173.529520:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664173.529550:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f8935f80 x1875550222167424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664173.529579:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222167424:0@lo:13: 00000004:00080000:2.0:1788664173.529599:0:6971:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788664173.529618:0:6971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222167552:0@lo:7: 00000100:00100000:2.0:1788664173.529647:0:6971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.529696:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167552 00000100:00100000:2.0:1788664173.529700:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167552 00000100:00100000:2.0:1788664173.533358:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664173.533380:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6971:x1875550222167552:12345-0@lo:7: 00000100:00100000:3.0:1788664173.534845:0:6971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c53570c0 going to sleep for 11 seconds 00002000:00080000:2.0:1788664173.547778:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788664173.547788:0:6697:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788664173.547901:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6971:x1875550222167552:12345-0@lo:7: Request processed in 14526us (18248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664173.547913:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788664173.548192:0:6971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f8935f80 x1875550222167552/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788664189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664173.548209:0:6971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222167552:0@lo:7: 00000004:00080000:3.0:1788664173.548224:0:6971:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788664173.548264:0:6971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222167680:0@lo:5: 00000100:00100000:3.0:1788664173.548303:0:6971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664173.548369:0:6971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664173.548832:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167680 00000100:00100000:3.0:1788664173.548848:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167680 00000100:00100000:3.0:1788664173.548896:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664173.548905:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6971:x1875550222167680:12345-0@lo:5: 00002000:00080000:3.0:1788664173.548931:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788664173.548935:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788664173.549212:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6971:x1875550222167680:12345-0@lo:5: Request processed in 308us (907us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788664173.549220:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788664173.549257:0:6971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9020a80 x1875550222167680/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664173.549269:0:6971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222167680:0@lo:5: 00000004:00080000:3.0:1788664173.549278:0:6971:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788664173.549307:0:6971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222167808:0@lo:700: 00000100:00100000:3.0:1788664173.549333:0:6971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664173.549369:0:6971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788664173.551481:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167808 00000100:00100000:1.0:1788664173.551495:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167808 00000100:00100000:1.0:1788664173.551550:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664173.551576:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6971:x1875550222167808:12345-0@lo:700: 00000100:00100000:1.0:1788664173.551629:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1875550222167936:0@lo:700: 00000100:00100000:1.0:1788664173.551685:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664173.551709:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d1edeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664173.551838:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222167936 00000100:00100000:1.0:1788664173.551842:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222167936 00000100:00100000:1.0:1788664173.551868:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664173.551874:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1875550222167936:12345-0@lo:700: 40000000:02000000:1.0:1788664173.638664:0:5861:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788664173.648407:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6703:x1875550222167936:12345-0@lo:700: Request processed in 96522us (96712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664173.648441:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788664173.648602:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f90fca80 x1875550222167936/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788664189 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664173.648618:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6703:1875550222167936:0@lo:700: 40000000:02000000:1.0:1788664173.648632:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788664173.741475:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6971:x1875550222167808:12345-0@lo:700: Request processed in 189891us (192130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664173.741491:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788664173.741587:0:6971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9020700 x1875550222167808/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788664189 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664173.741606:0:6971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222167808:0@lo:700: 00000001:00100000:3.0:1788664173.741949:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788664173.741966:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:2.0:1788664173.790143:0:6971:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788664173.805786:0:6971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222168064:0@lo:5: 00000100:00100000:2.0:1788664173.805860:0:6971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664173.805906:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168064 00000100:00100000:2.0:1788664173.805914:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168064 00000100:00100000:2.0:1788664173.805973:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664173.805983:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6971:x1875550222168064:12345-0@lo:5: 00000100:00100000:0.0:1788664173.810455:0:6971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357d80 going to sleep for 11 seconds 00002000:00080000:0.0:1788664173.815590:0:6697:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788664173.815614:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788664173.820185:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6971:x1875550222168064:12345-0@lo:5: Request processed in 14194us (14315us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788664173.820206:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788664173.820292:0:6971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f8937b80 x1875550222168064/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664189 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664173.820308:0:6971:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788664173.820324:0:6971:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9b68f8937b80 x1875550222168064/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664189 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664173.820336:0:6971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6971:1875550222168064:0@lo:5: 00000004:00080000:2.0:1788664173.827926:0:6971:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788664174.368759:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788664175.145304:0:7066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788664175.395044:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664176.417038:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664177.448518:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664178.472712:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222168448:0@lo:400: 00000100:00100000:0.0:1788664178.472802:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664178.472883:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222168576:0@lo:400: 00000100:00100000:0.0:1788664178.472910:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664178.473268:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222168192:0@lo:400: 00000100:00100000:3.0:1788664178.473303:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664178.473333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664178.473373:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222168320:0@lo:400: 00000100:00100000:3.0:1788664178.473401:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664178.473452:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168448 00000100:00100000:3.0:1788664178.473459:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168448 00000100:00100000:3.0:1788664178.473513:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168320 00000100:00100000:3.0:1788664178.473516:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168320 00000100:00100000:0.0:1788664178.473607:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168192 00000100:00100000:0.0:1788664178.473611:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168192 00000100:00100000:0.0:1788664178.473642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788664178.473652:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3307:x1875550222168192:12345-0@lo:400: 00000100:00100000:0.0:1788664178.473703:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3307:x1875550222168192:12345-0@lo:400: Request processed in 52us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664178.473711:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788664178.473887:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664178.473894:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222168448:12345-0@lo:400: 00000100:00100000:3.0:1788664178.474007:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222168448:12345-0@lo:400: Request processed in 112us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664178.474013:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664178.474027:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664178.474105:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222168320:12345-0@lo:400: 00000100:00100000:3.0:1788664178.474145:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222168320:12345-0@lo:400: Request processed in 42us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664178.474151:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664178.474174:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168576 00000100:00100000:3.0:1788664178.474177:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168576 00000100:00100000:3.0:1788664178.474207:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664178.474213:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222168576:12345-0@lo:400: 00000100:00100000:3.0:1788664178.474247:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222168576:12345-0@lo:400: Request processed in 35us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664178.474253:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788664178.474272:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664178.474277:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788664178.474310:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68c3415500 x1875550222168576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664178.474325:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222168576:0@lo:400: 00010000:00080000:3.0:1788664178.474381:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68c3415c00 x1875550222168320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664178.474407:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3415c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222168320:0@lo:400: 00000100:00100000:3.0:1788664178.474419:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222168192:0@lo:400: 00010000:00080000:0.0:1788664178.474493:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68c3416300 x1875550222168448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664178.474508:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222168448:0@lo:400: 00010000:00010000:3.0:1788664178.475119:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664178.975521:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222168704:0@lo:13: 00000100:00100000:2.0:1788664178.975612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664178.975691:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168704 00000100:00100000:2.0:1788664178.975699:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168704 00000100:00100000:2.0:1788664178.975765:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664178.975775:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222168704:12345-0@lo:13: 00002000:00000024:2.0:1788664178.975818:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664178.975865:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222168704:12345-0@lo:13: Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664178.975873:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664178.975914:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f8936300 x1875550222168704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664178.975949:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222168704:0@lo:13: 00000001:00080000:3.0:1788664179.100555:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788664179.488671:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664180.511476:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664181.535819:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664182.559711:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664183.583553:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664183.584016:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222169088:0@lo:400: 00000100:00100000:1.0:1788664183.584083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664183.584146:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664183.584152:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222168960:0@lo:400: 00000100:00100000:1.0:1788664183.584192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664183.584224:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169088 00000100:00100000:1.0:1788664183.584232:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169088 00000100:00100000:1.0:1788664183.584287:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168960 00000100:00100000:1.0:1788664183.584290:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168960 00000100:00100000:1.0:1788664183.584307:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664183.584315:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222169088:12345-0@lo:400: 00000100:00100000:1.0:1788664183.584390:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222169088:12345-0@lo:400: Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664183.584398:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664183.584416:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664183.584422:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222168960:12345-0@lo:400: 00000100:00100000:1.0:1788664183.584450:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222168960:12345-0@lo:400: Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664183.584456:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788664183.584475:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664183.584507:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f90fce00 x1875550222168960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664183.584521:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222168960:0@lo:400: 00010000:00080000:1.0:1788664183.584532:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f90fea00 x1875550222169088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664183.584542:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222169088:0@lo:400: 00000100:00100000:3.0:1788664183.584636:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222168832:0@lo:400: 00000100:00100000:3.0:1788664183.584691:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664183.584725:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664183.584732:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222169216:0@lo:400: 00000100:00100000:3.0:1788664183.584759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664183.585174:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222168832 00000100:00100000:1.0:1788664183.585181:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222168832 00000100:00100000:1.0:1788664183.585213:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788664183.585220:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3308:x1875550222168832:12345-0@lo:400: 00000100:00100000:0.0:1788664183.585375:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169216 00000100:00100000:0.0:1788664183.585380:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169216 00000100:00100000:0.0:1788664183.585421:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664183.585427:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222169216:12345-0@lo:400: 00000100:00100000:1.0:1788664183.585500:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3308:x1875550222168832:12345-0@lo:400: Request processed in 280us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664183.585506:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788664183.595011:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664183.595899:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222169216:12345-0@lo:400: Request processed in 10465us (11132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664183.595915:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664183.603516:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222168832:0@lo:400: 00010000:00080000:1.0:1788664183.603625:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f90ff100 x1875550222169216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664183.603647:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788664183.603659:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222169216:0@lo:400: 00000100:00100000:1.0:1788664184.102241:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222169344:0@lo:13: 00000100:00100000:1.0:1788664184.102330:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664184.102665:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169344 00000100:00100000:2.0:1788664184.102674:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169344 00000100:00100000:2.0:1788664184.102725:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664184.102735:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222169344:12345-0@lo:13: 00002000:00000024:2.0:1788664184.102775:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664184.107072:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222169344:12345-0@lo:13: Request processed in 4329us (4732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664184.107087:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788664184.109469:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9021f80 x1875550222169344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664184.109501:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222169344:0@lo:13: 00010000:00010000:3.0:1788664184.610814:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664185.639914:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664186.655876:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664187.679776:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788664188.002043:0:7638:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:2.0:1788664188.002048:0:7638:0:(obd_mount.c:924:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788664188.002265:0:7638:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b68c343c800 00000020:01000004:2.0:1788664188.002284:0:7638:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788664188.002297:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788664188.002313:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b68c8fe19c0) 00000020:00000080:2.0:1788664188.002331:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788664188.019990:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788664188.020376:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788664188.058808:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788664188.068823:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788664188.068860:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788664188.068992:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788664188.069019:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788664188.069602:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788664188.069616:0:7638:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788664188.069628:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x762f55027be90038 00000020:01000004:0.0:1788664188.069704:0:7638:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788664188.069730:0:7638:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788664188.069733:0:7638:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788664188.069740:0:7638:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788664188.069763:0:7638:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788664188.069767:0:7638:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788664188.093871:0:7638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788664188.093973:0:7638:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.114@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788664188.093978:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788664188.093980:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664188.093982:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664188.093983:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664188.093985:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664188.093986:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664188.093988:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664188.093989:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664188.093990:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664188.093992:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664188.093993:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664188.093997:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788664188.094002:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664188.094003:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664188.094005:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664188.094006:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664188.094007:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664188.094008:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664188.094009:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664188.094010:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664188.094011:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664188.094012:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664188.094013:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788664188.094040:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788664188.094058:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222169472:0@lo:253: 00000100:00100000:1.0:1788664188.094144:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.094274:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664188.094627:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169472 00000100:00100000:0.0:1788664188.094702:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169472 00000100:00100000:1.0:1788664188.094857:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664188.094867:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:7638:x1875550222169472:12345-0@lo:253: 20000000:01000000:1.0:1788664188.094911:0:5849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788664188.094915:0:5849:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788664188.094921:0:5849:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788664188.094924:0:5849:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788664188.095998:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664188.096214:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788664188.096237:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788664188.096279:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788664188.096288:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788664188.096319:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788664188.096395:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788664188.096774:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788664188.096792:0:5849:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:1.0:1788664188.096794:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788664188.096828:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788664188.096836:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788664188.096902:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788664188.096918:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:1.0:1788664188.096953:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788664188.096962:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788664188.096990:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788664188.097036:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788664188.097798:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788664188.097815:0:5849:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.114@tcp 20000000:01000000:1.0:1788664188.097817:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.114@tcp (null) (null) (null) 00000040:00080000:1.0:1788664188.097850:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788664188.097857:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788664188.097888:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788664188.097896:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.114@tcp (null) (null) 00000040:00080000:1.0:1788664188.097925:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788664188.097933:0:5849:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788664188.097976:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788664188.098011:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788664188.098024:0:5849:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788664188.098026:0:5849:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788664188.098030:0:5849:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788664188.098043:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788664188.098045:0:5849:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788664188.098082:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788664188.098085:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788664188.099701:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788664188.099798:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788664188.099836:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788664188.100841:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788664188.100891:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788664188.101050:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788664188.101063:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788664188.101066:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788664188.101854:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788664188.101985:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788664188.102046:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788664188.102598:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788664188.102725:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788664188.102767:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788664188.102781:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788664188.102793:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788664188.103333:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788664188.104126:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788664188.104201:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788664188.105039:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788664188.105108:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788664188.105200:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788664188.105217:0:5849:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788664188.105220:0:5849:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788664188.106177:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788664188.106871:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788664188.106988:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788664188.107060:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788664188.107081:0:5849:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788664188.107083:0:5849:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788664188.107094:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788664188.107118:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107137:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff89 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107159:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107166:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffdd expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107173:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8fff9 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107179:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90023 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107185:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107236:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be90023 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107250:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be90023 expref: 16 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.107265:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169600:0@lo:104: 00000100:00100000:3.0:1788664188.107620:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664188.107776:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8fff9 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107787:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8fff9 expref: 16 pid: 5847 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.107796:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9022680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169728:0@lo:104: 00010000:00010000:3.0:1788664188.107830:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ffdd expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107838:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ffdd expref: 16 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.107846:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169856:0@lo:104: 00010000:00010000:3.0:1788664188.107865:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.107872:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 16 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.107878:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169984:0@lo:104: 00010000:00010000:3.0:1788664188.107895:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ff89 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664188.107989:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788664188.108008:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.108035:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.108042:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.108053:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169600 00000100:00100000:1.0:1788664188.108060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169600 00000100:00100000:1.0:1788664188.108101:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169728 00000100:00100000:1.0:1788664188.108104:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169728 00000100:00100000:1.0:1788664188.108115:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169856 00000100:00100000:1.0:1788664188.108118:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169856 00000100:00100000:1.0:1788664188.108127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222169984 00000100:00100000:1.0:1788664188.108130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222169984 00000100:00100000:1.0:1788664188.108141:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664188.108148:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c8fa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:5849:x1875550222169600:12345-0@lo:104: 00010000:00010000:1.0:1788664188.108161:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664188.108266:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664188.108273:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c8fa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:5849:x1875550222169600:12345-0@lo:104: Request processed in 125us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664188.108279:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664188.108320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664188.108326:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5849:x1875550222169728:12345-0@lo:104: 00010000:00010000:1.0:1788664188.108334:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.108482:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ff89 expref: 16 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.108492:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222170112:0@lo:104: 00000100:00100000:3.0:1788664188.108662:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.108722:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.108745:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169600:0@lo:104: 00010000:00010000:0.0:1788664188.108851:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664188.108859:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.108866:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664188.108870:0:5843:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.108878:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664188.108884:0:5843:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664188.108890:0:5843:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664188.108940:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.108947:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664188.108967:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.108975:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef000/0x762f55027be90023 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be9002a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.108990:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664188.108992:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664188.108994:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664188.109015:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222170240:0@lo:103: 00000100:00100000:0.0:1788664188.109048:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.109188:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222170240 00000100:00100000:3.0:1788664188.109194:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222170240 00010000:00010000:3.0:1788664188.109215:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be90023 expref: 17 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.109257:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664188.109272:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:3309:x1875550222170240:12345-0@lo:103: 00010000:00010000:3.0:1788664188.109284:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664188.109290:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be90023 expref: 17 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.109301:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be90023 expref: 17 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.109315:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66eee00/0x762f55027be9002a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be90023 expref: 17 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.109329:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664188.109528:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3309:x1875550222170240:12345-0@lo:103: Request processed in 256us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.109536:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664188.109565:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222170240:0@lo:103: 00010000:00010000:1.0:1788664188.109763:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664188.109770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5849:x1875550222169728:12345-0@lo:104: Request processed in 1444us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664188.109784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664188.109800:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222170112 00000100:00100000:1.0:1788664188.109803:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222170112 00000100:00100000:3.0:1788664188.109856:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9022680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169728:0@lo:104: 00010000:00010000:0.0:1788664188.109892:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664188.109967:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.109977:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215ba00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664188.109981:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.109990:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664188.109998:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664188.110004:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664188.110040:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.110047:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664188.110058:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.110066:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215ba00/0x762f55027be8fff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90000 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.110078:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664188.110080:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664188.110081:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664188.110122:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664188.110132:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222170368:0@lo:103: 00000100:00100000:3.0:1788664188.110166:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664188.110278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664188.110291:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5849:x1875550222169856:12345-0@lo:104: 00010000:00010000:2.0:1788664188.110301:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.110371:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664188.110384:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:5849:x1875550222169856:12345-0@lo:104: Request processed in 98us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.110522:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222170368 00000100:00100000:0.0:1788664188.110532:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222170368 00010000:00010000:0.0:1788664188.110551:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fff9 expref: 16 pid: 5847 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664188.110571:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664188.110578:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3309:x1875550222170368:12345-0@lo:103: 00010000:00010000:0.0:1788664188.110588:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664188.110592:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8fff9 expref: 16 pid: 5847 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.110602:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8fff9 expref: 16 pid: 5847 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.110615:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215ac00/0x762f55027be90000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8fff9 expref: 16 pid: 5847 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.110629:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664188.110667:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3309:x1875550222170368:12345-0@lo:103: Request processed in 89us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.110673:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664188.110764:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664188.110781:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664188.110789:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:5849:x1875550222169984:12345-0@lo:104: 00010000:00010000:2.0:1788664188.110799:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.110843:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664188.110848:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:5849:x1875550222169984:12345-0@lo:104: Request processed in 61us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.110854:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664188.110867:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664188.110874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5849:x1875550222170112:12345-0@lo:104: 00010000:00010000:2.0:1788664188.110881:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.110930:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788664188.110935:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5849:x1875550222170112:12345-0@lo:104: Request processed in 62us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.110940:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788664188.110956:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788664188.110961:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.110967:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215b800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664188.110978:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.110987:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664188.110994:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664188.110999:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664188.111027:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111033:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664188.111050:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111057:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215b800/0x762f55027be8ffdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffe4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111070:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664188.111073:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111078:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664188.111082:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111088:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664188.111105:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664188.111111:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664188.111126:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111132:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664188.111137:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111143:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee600/0x762f55027be8ffb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffba expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111154:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664188.111157:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111162:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664188.111164:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111170:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664188.111175:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664188.111180:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788664188.111199:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111205:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664188.111211:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111217:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be8ff89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff90 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111244:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664188.111246:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664188.111247:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664188.111263:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222170496:0@lo:103: 00000100:00100000:2.0:1788664188.111307:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664188.111615:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664188.111622:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222170624:0@lo:103: 00000100:00100000:2.0:1788664188.111722:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664188.111760:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222170496 00000100:00100000:2.0:1788664188.111767:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222170496 00010000:00010000:2.0:1788664188.111786:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffdd expref: 15 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664188.111801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222170624 00000100:00100000:2.0:1788664188.111803:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222170624 00010000:00010000:2.0:1788664188.111815:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 16 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664188.111828:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664188.111835:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3307:x1875550222170496:12345-0@lo:103: 00010000:00010000:2.0:1788664188.111855:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664188.111861:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffdd expref: 16 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111871:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ffdd expref: 16 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.111885:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664188.111994:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664188.112122:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222170752:0@lo:103: 00000100:00100000:3.0:1788664188.112153:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.112179:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222170368:0@lo:103: 00000100:00100000:3.0:1788664188.112209:0:5842:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788664188.112217:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788664188.112263:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479000/0x762f55027be8ffe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ffdd expref: 16 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.112291:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169856:0@lo:104: 00000100:00100000:3.0:1788664188.112304:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222169984:0@lo:104: 00000100:00100000:3.0:1788664188.112312:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5849:1875550222170112:0@lo:104: 00010000:00010000:3.0:1788664188.112336:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664188.112435:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3307:x1875550222170496:12345-0@lo:103: Request processed in 600us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.112443:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664188.112459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222170752 00000100:00100000:2.0:1788664188.112463:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222170752 00010000:00010000:2.0:1788664188.112477:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff89 expref: 15 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664188.112490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664188.112496:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3307:x1875550222170624:12345-0@lo:103: 00010000:00010000:2.0:1788664188.112505:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664188.112510:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 15 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112518:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 15 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112529:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215a600/0x762f55027be8ffba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ffb3 expref: 15 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112540:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664188.112564:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:3307:x1875550222170624:12345-0@lo:103: Request processed in 68us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.112578:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664188.112592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788664188.112597:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3309:x1875550222170752:12345-0@lo:103: 00010000:00010000:2.0:1788664188.112606:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664188.112610:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff89 expref: 13 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112619:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ff89 expref: 13 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112640:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66eea00/0x762f55027be8ff90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ff89 expref: 13 pid: 5848 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112653:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112661:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112675:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112683:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112691:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112698:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112714:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664188.112718:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112726:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112746:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.112755:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664188.112786:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3309:x1875550222170752:12345-0@lo:103: Request processed in 189us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.112792:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788664188.112817:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664188.112837:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222170752:0@lo:103: 00010000:00010000:3.0:1788664188.113030:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.113038:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.113045:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147a200/0x762f55027be9003f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664188.113060:0:5849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788664188.114801:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222170496:0@lo:103: 00000100:00100000:1.0:1788664188.116527:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222170624:0@lo:103: 00000100:00100000:3.0:1788664188.197510:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:7638:x1875550222169472:12345-0@lo:253: Request processed in 102632us (103355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.197525:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664188.197540:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222169472:0@lo:253: 10000000:01000000:1.0:1788664188.197558:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788664188.197561:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788664188.197563:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664188.197565:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664188.197566:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788664188.197567:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664188.197568:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664188.197570:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664188.197571:0:7638:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788664188.197573:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664188.197574:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788664188.197596:0:7638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b68c343c800 from lustre-OST0001 10000000:01000000:1.0:1788664188.197686:0:7638:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788664188.197689:0:7638:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788664188.197697:0:7638:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b68c3f919c0 local copy 10000000:01000000:1.0:1788664188.197701:0:7638:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788664188.197744:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664188.197756:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664188.197764:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664188.197778:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222170880:0@lo:101: 00000100:00100000:1.0:1788664188.197832:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.197883:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40780 going to sleep for 11 seconds 00000100:00100000:0.0:1788664188.197983:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222170880 00000100:00100000:0.0:1788664188.197989:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222170880 00000100:00100000:0.0:1788664188.198050:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664188.198058:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+11:7638:x1875550222170880:12345-0@lo:101: 00010000:00010000:0.0:1788664188.198069:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664188.198082:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ef000/0x762f55027be9004d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be90046 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.198111:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ef000/0x762f55027be9004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be90046 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.198118:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ef000/0x762f55027be9004d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90046 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.198126:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef000, rc 0) 00000100:00100000:0.0:1788664188.198158:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222170880:12345-0@lo:101: Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.198162:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788664188.198212:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222170880:0@lo:101: 00010000:00010000:2.0:1788664188.198239:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.198246:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664188.198374:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171008:0@lo:501: 00000100:00100000:2.0:1788664188.198412:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664188.198703:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c583c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664188.198734:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171008 00000100:00100000:1.0:1788664188.198742:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171008 00000100:00100000:3.0:1788664188.198834:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788664188.198843:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171008:12345-0@lo:501: 00000100:00100000:3.0:1788664188.199564:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171008:12345-0@lo:501: Request processed in 719us (1149us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664188.199573:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664188.199740:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171008:0@lo:501: 10000000:01000000:3.0:1788664188.199962:0:7638:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788664188.199996:0:7638:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788664188.200007:0:7638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.200015:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.200020:0:7638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.200035:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788664188.200056:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b68c343c800 10000000:01000000:3.0:1788664188.200061:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788664188.200064:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1788664188.200067:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788664188.200069:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788664188.200070:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664188.200074:0:7638:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788664188.200077:0:7638:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788664188.200078:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664188.200081:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.200089:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664188.200096:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664188.200102:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664188.200105:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.200113:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.200122:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.200127:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.200132:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788664188.200140:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171136:0@lo:101: 00000100:00100000:3.0:1788664188.200174:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.200182:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222171264:0@lo:103: 00000100:00100000:1.0:1788664188.200228:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664188.200277:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.200281:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357240 going to sleep for 11 seconds 00010000:00010000:2.0:1788664188.200286:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be90046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x762f55027be9004d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.200299:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664188.200300:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664188.200302:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664188.200313:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171264 00000100:00100000:2.0:1788664188.200319:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171264 00000100:00100000:0.0:1788664188.200373:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171136 00000100:00100000:0.0:1788664188.200378:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171136 00000100:00100000:0.0:1788664188.200464:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788664188.200473:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222171136:12345-0@lo:101: 00000100:00100000:2.0:1788664188.200475:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788664188.200484:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788664188.200487:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3310:x1875550222171264:12345-0@lo:103: 00010000:00010000:0.0:1788664188.200496:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be90054 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.200497:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664188.200508:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ef000/0x762f55027be9004d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be90046 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.200512:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be90054 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.200520:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664188.200521:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90054 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.200528:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef800, rc 0) 00000100:00100000:0.0:1788664188.200556:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222171136:12345-0@lo:101: Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.200573:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664188.200728:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3310:x1875550222171264:12345-0@lo:103: Request processed in 240us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.200735:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664188.200765:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171136:0@lo:101: 00010000:00010000:3.0:1788664188.200777:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.200793:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.200868:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171392:0@lo:501: 00000100:00100000:1.0:1788664188.201030:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222171264:0@lo:103: 00000100:00100000:3.0:1788664188.201072:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.201137:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664188.201170:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171392 00000100:00100000:0.0:1788664188.201175:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171392 00000100:00100000:3.0:1788664188.201285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788664188.201293:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171392:12345-0@lo:501: 00000100:00100000:3.0:1788664188.201810:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171392:12345-0@lo:501: Request processed in 514us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.201817:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788664188.201950:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171392:0@lo:501: 00000100:00100000:0.0:1788664188.201981:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171520:0@lo:503: 00000100:00100000:0.0:1788664188.202016:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.202041:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.202057:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171520 00000100:00100000:3.0:1788664188.202063:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171520 00000100:00100000:3.0:1788664188.202090:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788664188.202098:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171520:12345-0@lo:503: 00000100:00100000:3.0:1788664188.202246:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171520:12345-0@lo:503: Request processed in 147us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.202253:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788664188.202274:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171520:0@lo:503: 00000040:00080000:0.0:1788664188.202819:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664188.202875:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171648:0@lo:502: 00000100:00100000:0.0:1788664188.202906:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.202930:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.202949:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171648 00000100:00100000:3.0:1788664188.202954:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171648 00000100:00100000:3.0:1788664188.202988:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788664188.202995:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171648:12345-0@lo:502: 00000100:00100000:3.0:1788664188.203259:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171648:12345-0@lo:502: Request processed in 263us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.203259:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171648:0@lo:502: 00000100:00100000:3.0:1788664188.203266:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:0.0:1788664188.203852:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788664188.203893:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788664188.203910:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788664188.203946:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788664188.203968:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788664188.203985:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788664188.204006:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171776:0@lo:502: 00000100:00100000:0.0:1788664188.204039:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.204065:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f259c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.204084:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171776 00000100:00100000:3.0:1788664188.204090:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171776 00000100:00100000:3.0:1788664188.204118:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788664188.204127:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171776:12345-0@lo:502: 00000100:00100000:3.0:1788664188.204270:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171776:12345-0@lo:502: Request processed in 143us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.204277:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788664188.204300:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171776:0@lo:502: 00000040:00080000:0.0:1788664188.204549:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788664188.204560:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788664188.205146:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788664188.205154:0:7646:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788664188.205159:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664188.205161:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788664188.205170:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664188.205192:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b68e7e63380) 00000020:00000080:2.0:1788664188.205212:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788664188.205231:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788664188.205282:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68c343c800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788664188.205287:0:7646:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788664188.205292:0:7646:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x762f55027be90069 00010000:00010000:3.0:1788664188.210569:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788664188.210921:0:7646:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788664188.214178:0:7646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788664188.214871:0:7646:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788664188.220774:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788664188.221324:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788664188.222934:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788664188.222947:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664188.222955:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664188.222957:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788664188.222961:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664188.222965:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664188.222966:0:7646:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788664188.222969:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788664188.222971:0:7646:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788664188.223023:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664188.223026:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664188.223027:0:7646:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788664188.223031:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788664188.223189:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788664188.223229:0:7638:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788664188.223254:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.223270:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664188.223279:0:7638:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68c343c800 from 1 10000000:01000000:3.0:1788664188.223283:0:7638:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664188.223328:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.223337:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.223503:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.223535:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171904:0@lo:101: 00000100:00100000:3.0:1788664188.223607:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.223718:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222171904 00000100:00100000:3.0:1788664188.223726:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222171904 00000100:00100000:3.0:1788664188.223769:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788664188.223778:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:7638:x1875550222171904:12345-0@lo:101: 00010000:00010000:3.0:1788664188.223793:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664188.223805:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be90070 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.223830:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be90070 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.223842:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90070 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.223851:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a400, rc 0) 00000100:00100000:3.0:1788664188.223884:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222171904:12345-0@lo:101: Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.223891:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788664188.223935:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c85cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.223955:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222171904:0@lo:101: 00010000:00010000:3.0:1788664188.223970:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.223980:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664188.224098:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172032:0@lo:501: 00000100:00100000:3.0:1788664188.224124:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.224149:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172032 00000100:00100000:3.0:1788664188.224153:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172032 00000100:00100000:3.0:1788664188.224175:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788664188.224182:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172032:12345-0@lo:501: 00000100:00100000:3.0:1788664188.225607:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172032:12345-0@lo:501: Request processed in 1419us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.225740:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788664188.225799:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c85cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.225819:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172032:0@lo:501: 00000100:00100000:3.0:1788664188.225864:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172160:0@lo:503: 00000100:00100000:3.0:1788664188.225913:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.225936:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c85cb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.225952:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172160 00000100:00100000:3.0:1788664188.225957:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172160 00000100:00100000:3.0:1788664188.225988:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788664188.225996:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172160:12345-0@lo:503: 00000100:00100000:3.0:1788664188.227732:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172160:12345-0@lo:503: Request processed in 1728us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.227747:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788664188.227826:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172160:0@lo:503: 00000040:00080000:3.0:1788664188.228155:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664188.228248:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172288:0@lo:502: 00000100:00100000:3.0:1788664188.228319:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.229518:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c85cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664188.229694:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172288 00000100:00100000:0.0:1788664188.229704:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172288 00000100:00100000:0.0:1788664188.229762:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788664188.229779:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172288:12345-0@lo:502: 00000100:00100000:0.0:1788664188.230052:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172288:12345-0@lo:502: Request processed in 275us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.230061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788664188.230286:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172288:0@lo:502: 00000040:00080000:3.0:1788664188.230797:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788664188.230857:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788664188.230896:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172416:0@lo:502: 00000100:00100000:3.0:1788664188.230950:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.230986:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c85cb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664188.231062:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172416 00000100:00100000:2.0:1788664188.231067:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172416 00000100:00100000:2.0:1788664188.231108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788664188.231116:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172416:12345-0@lo:502: 00000100:00100000:2.0:1788664188.231289:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172416:12345-0@lo:502: Request processed in 173us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.231297:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788664188.231605:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172416:0@lo:502: 00000040:00080000:3.0:1788664188.231790:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788664188.231801:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788664188.232740:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664188.232752:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664188.232754:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788664188.232761:0:7650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68c343c800 00000020:00000080:3.0:1788664188.232763:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788664188.232782:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664188.232786:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664188.232788:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788664188.232790:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788664188.232918:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788664188.232943:0:7638:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664188.232967:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.232990:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664188.233192:0:7638:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788664188.233196:0:7638:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff9b68c343c800 10000000:01000000:2.0:1788664188.233199:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b68c343c800 10000000:01000000:2.0:1788664188.233203:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788664188.233209:0:7638:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68c343c800 from 1 10000000:01000000:2.0:1788664188.233223:0:7638:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664188.233262:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.233272:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664188.233283:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664188.233305:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172544:0@lo:101: 00000100:00100000:2.0:1788664188.233535:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664188.233572:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c50ed480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.233717:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172544 00000100:00100000:3.0:1788664188.233725:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172544 00000100:00100000:3.0:1788664188.233773:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788664188.233782:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222172544:12345-0@lo:101: 00010000:00010000:3.0:1788664188.233795:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664188.233810:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9007e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.233838:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9007e expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.233860:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9007e expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.233870:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b200, rc 0) 00000100:00100000:3.0:1788664188.233921:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222172544:12345-0@lo:101: Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.233928:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788664188.234024:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172544:0@lo:101: 00010000:00010000:0.0:1788664188.234090:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.234100:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664188.234271:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172672:0@lo:501: 00000100:00100000:0.0:1788664188.234299:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.234329:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f256c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.234725:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172672 00000100:00100000:3.0:1788664188.234731:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172672 00000100:00100000:3.0:1788664188.235739:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788664188.235755:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222172672:12345-0@lo:501: 00000100:00100000:3.0:1788664188.236047:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222172672:12345-0@lo:501: Request processed in 296us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.236055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788664188.237328:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172672:0@lo:501: 00000100:00100000:0.0:1788664188.237410:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172800:0@lo:503: 00000100:00100000:0.0:1788664188.237474:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.241916:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f256c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664188.242552:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172800 00000100:00100000:2.0:1788664188.242563:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172800 00000100:00100000:2.0:1788664188.242792:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788664188.242806:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222172800:12345-0@lo:503: 00000100:00100000:2.0:1788664188.243280:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222172800:12345-0@lo:503: Request processed in 476us (5804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.243289:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788664188.243807:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172800:0@lo:503: 00000040:00080000:1.0:1788664188.244279:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664188.244604:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172928:0@lo:502: 00000100:00100000:1.0:1788664188.244738:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.244816:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.244856:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222172928 00000100:00100000:3.0:1788664188.244862:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222172928 00000100:00100000:3.0:1788664188.244949:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788664188.244959:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222172928:12345-0@lo:502: 00000100:00100000:3.0:1788664188.245206:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222172928:12345-0@lo:502: Request processed in 246us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.245225:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788664188.245312:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222172928:0@lo:502: 00000040:00080000:1.0:1788664188.245638:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788664188.245691:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788664188.245727:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788664188.245787:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788664188.245826:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788664188.245874:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788664188.245909:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788664188.245941:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788664188.245988:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788664188.246024:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788664188.246058:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788664188.246120:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788664188.246162:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788664188.246223:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788664188.246289:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788664188.246328:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788664188.246391:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788664188.246441:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788664188.246483:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788664188.246518:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788664188.246564:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788664188.246597:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788664188.246628:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788664188.246673:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788664188.246708:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788664188.246742:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788664188.246790:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788664188.246827:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788664188.246865:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788664188.246929:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788664188.246967:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788664188.247023:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788664188.247058:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788664188.247108:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788664188.247144:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788664188.247207:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788664188.247263:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788664188.247317:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222173056:0@lo:502: 00000100:00100000:1.0:1788664188.247420:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.248656:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664188.248800:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173056 00000100:00100000:2.0:1788664188.248809:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173056 00000100:00100000:2.0:1788664188.248857:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788664188.248868:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222173056:12345-0@lo:502: 00000100:00100000:2.0:1788664188.249607:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222173056:12345-0@lo:502: Request processed in 738us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.249626:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788664188.249902:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222173056:0@lo:502: 00000040:00080000:1.0:1788664188.250031:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788664188.250046:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788664188.251084:0:7651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788664188.251102:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b68f8feb380) 00000020:00000080:3.0:1788664188.251729:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788664188.251850:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68c343c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788664188.251855:0:7651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68c343c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788664188.251857:0:7651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68c343c800 3 00010000:00080000:3.0:1788664188.251896:0:7651:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b68f85df800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.114@tcp at head 00010000:00010000:3.0:1788664188.255245:0:7651:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788664188.256075:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788664188.256802:0:7651:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788664188.256817:0:7651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x762f55027be90093 00000100:00080000:3.0:1788664188.256828:0:7651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664188.256835:0:7651:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b68f85df800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664188.256872:0:7651:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68f9020a80 x1875550222173184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664188.256939:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875550222173184:0@lo:38: 00000100:00100000:2.0:1788664188.257013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.258231:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173184 00000100:00100000:0.0:1788664188.258240:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173184 00000100:00100000:0.0:1788664188.258285:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664188.258293:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875550222173184:12345-0@lo:38: 00010000:00080000:0.0:1788664188.258324:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1788664188.258402:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x762f55027be9009a 00000004:00100000:0.0:1788664188.258421:0:5855:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788664188.258455:0:5855:0:(import.c:65:import_set_state_nolock()) ffff9b67c536d800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788664188.259580:0:7651:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788664188.259702:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222173312:0@lo:400: 00000100:00100000:3.0:1788664188.259754:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.259789:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664188.259795:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222173440:0@lo:400: 00000100:00100000:3.0:1788664188.259820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.259836:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664188.259844:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222173568:0@lo:400: 00000100:00100000:3.0:1788664188.259869:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.259895:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788664188.259902:0:5854:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788664188.259917:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173568 00000100:00100000:3.0:1788664188.259923:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173568 00000100:00100000:3.0:1788664188.259974:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664188.259983:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222173568:12345-0@lo:400: 00000100:00100000:3.0:1788664188.260024:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222173568:12345-0@lo:400: Request processed in 43us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.260031:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788664188.260050:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664188.260090:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9023800 x1875550222173568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664188.260105:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222173568:0@lo:400: 00000100:00100000:0.0:1788664188.261236:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875550222173184:12345-0@lo:38: Request processed in 2940us (4220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.261249:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664188.261273:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173312 00000100:00100000:0.0:1788664188.261278:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173312 00000100:00100000:0.0:1788664188.261301:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173440 00000100:00100000:0.0:1788664188.261304:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173440 00000100:00100000:0.0:1788664188.261335:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664188.261369:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222173312:12345-0@lo:400: 00010000:00080000:2.0:1788664188.261518:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9020a80 x1875550222173184/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664188.261529:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788664188.261539:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788664188.261546:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788664188.261551:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788664188.261555:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f85df800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788664188.261561:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875550222173184:0@lo:38: 00000100:00100000:2.0:1788664188.261808:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788664188.261817:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222173440:12345-0@lo:400: 00000100:00100000:2.0:1788664188.261882:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222173440:12345-0@lo:400: Request processed in 66us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.261889:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788664188.261921:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9022680 x1875550222173440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664188.261931:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9022680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222173440:0@lo:400: 00000100:00100000:0.0:1788664188.262269:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222173312:12345-0@lo:400: Request processed in 927us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.262276:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788664188.265922:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788664188.266058:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9021f80 x1875550222173312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664188.266075:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222173312:0@lo:400: 00000040:00080000:2.0:1788664188.266706:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788664188.266982:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7654:1875550222173696:0@lo:901: 00000100:00100000:3.0:1788664188.267074:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664188.267181:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173696 00000100:00100000:3.0:1788664188.267188:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173696 00000100:00100000:3.0:1788664188.267254:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664188.267263:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1875550222173696:12345-0@lo:901: 00000100:00100000:3.0:1788664188.267897:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7654:x1875550222173696:12345-0@lo:901: Request processed in 633us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.267906:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788664188.267931:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664188.267943:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58eb0c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788664188.267963:0:7654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68f9023800 x1875550222173696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788664204 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664188.267975:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7654:1875550222173696:0@lo:901: 00000020:01000000:1.0:1788664188.270328:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788664188.270406:0:7638:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788664188.270425:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664188.270439:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788664188.270506:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788664188.270508:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664188.270510:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664188.270511:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664188.270512:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664188.270514:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664188.270515:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664188.270517:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664188.270518:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664188.270520:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664188.270521:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664188.270526:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788664188.270528:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788664188.270530:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664188.270531:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664188.270532:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664188.270533:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664188.270535:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664188.270541:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664188.270542:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664188.270543:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664188.270544:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664188.270545:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788664188.270573:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788664188.270590:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222173824:0@lo:253: 00000100:00100000:1.0:1788664188.270675:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664188.270712:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664188.270962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173824 00000100:00100000:2.0:1788664188.270969:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173824 00000100:00100000:2.0:1788664188.271028:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788664188.271039:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7638:x1875550222173824:12345-0@lo:253: 20000000:01000000:2.0:1788664188.271088:0:5848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788664188.271103:0:5848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788664188.319944:0:5848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788664188.319966:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788664188.320033:0:5870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788664188.320038:0:5870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788664188.320063:0:5870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.320085:0:5870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffeb expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.320095:0:5870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.320149:0:5870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ffeb expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.320165:0:5870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ffeb expref: 14 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664188.320181:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5870:1875550222173952:0@lo:104: 00000100:00100000:0.0:1788664188.320266:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.320580:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3fef780 going to sleep for 11 seconds 00000100:00100000:3.0:1788664188.320644:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222173952 00000100:00100000:3.0:1788664188.320652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222173952 00000100:00100000:3.0:1788664188.320710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788664188.320720:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5870:x1875550222173952:12345-0@lo:104: 00010000:00010000:3.0:1788664188.320735:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664188.320787:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664188.320799:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:5870:x1875550222173952:12345-0@lo:104: Request processed in 81us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664188.320808:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788664188.320929:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664188.320935:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.320942:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215a400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664188.320946:0:5843:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.320955:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664188.320961:0:5843:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664188.320968:0:5843:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664188.321050:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321058:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664188.321080:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321088:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be8ffeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8fff2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321118:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664188.321120:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664188.321122:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664188.321134:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222174080:0@lo:103: 00000100:00100000:0.0:1788664188.321169:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664188.321229:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174080 00000100:00100000:0.0:1788664188.321234:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174080 00010000:00010000:0.0:1788664188.321253:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffeb expref: 15 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664188.321278:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664188.321284:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3310:x1875550222174080:12345-0@lo:103: 00010000:00010000:0.0:1788664188.321307:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664188.321313:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffeb expref: 15 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321323:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ffeb expref: 15 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321633:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321643:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788664188.321659:0:5842:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001852694s 00010000:00010000:0.0:1788664188.321664:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321672:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321679:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321687:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321704:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664188.321709:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321717:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321726:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321736:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664188.321769:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5892c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3310:x1875550222174080:12345-0@lo:103: Request processed in 484us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664188.321777:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664188.321845:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222174080:0@lo:103: 00010000:00010000:0.0:1788664188.321881:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b400/0x762f55027be8fff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ffeb expref: 14 pid: 5849 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664188.321891:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5870:1875550222173952:0@lo:104: 00010000:00010000:0.0:1788664188.321901:0:5870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321909:0:5870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321915:0:5870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664188.321922:0:5870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ee400/0x762f55027be900a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664188.331294:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:7638:x1875550222173824:12345-0@lo:253: Request processed in 60246us (60608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664188.331309:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788664188.331481:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25199117-f21d-4733-8eaf-e8fb9fef1d54:7638:1875550222173824:0@lo:253: 10000000:01000000:1.0:1788664188.331499:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788664188.331502:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788664188.331503:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788664188.331505:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788664188.331506:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788664188.331507:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788664188.331509:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788664188.331510:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788664188.331512:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788664188.331513:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788664188.331515:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788664188.331517:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788664188.331532:0:7638:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788664188.338890:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664188.339187:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788664188.339750:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664188.339937:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788664188.340234:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664188.340827:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788664188.342070:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788664188.605529:0:7638:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788664188.605536:0:7638:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788664188.605660:0:7638:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788664188.605732:0:7638:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788664188.605749:0:7638:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788664188.605778:0:7638:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788664188.720479:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664189.215704:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664189.215730:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222174208:0@lo:13: 00000100:00100000:3.0:1788664189.215799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664189.215871:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174208 00000100:00100000:3.0:1788664189.215879:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174208 00000100:00100000:3.0:1788664189.215921:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664189.215930:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222174208:12345-0@lo:13: 00002000:00000024:3.0:1788664189.215966:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664189.216009:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222174208:12345-0@lo:13: Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664189.216016:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788664189.216054:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f9023800 x1875550222174208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664189.216074:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222174208:0@lo:13: 00010000:00010000:3.0:1788664189.735466:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664190.752802:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664191.782821:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664192.799585:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664193.312380:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664193.312419:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222174720:0@lo:400: 00000100:00100000:0.0:1788664193.312419:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222174464:0@lo:400: 00000100:00100000:3.0:1788664193.312490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222174848:0@lo:400: 00000100:00100000:1.0:1788664193.317431:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222174592:0@lo:400: 00000100:00100000:2.0:1788664193.317618:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664193.320503:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222174336:0@lo:400: 00000100:00100000:2.0:1788664193.320619:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664193.322392:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174720 00000100:00100000:2.0:1788664193.322411:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174720 00000100:00100000:2.0:1788664193.322514:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664193.322527:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222174720:12345-0@lo:400: 00000100:00100000:2.0:1788664193.322631:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222174720:12345-0@lo:400: Request processed in 108us (5015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664193.322677:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788664193.323524:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3416300 x1875550222174720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664193.323547:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222174720:0@lo:400: 00000100:00080000:2.0:1788664193.323617:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664193.324023:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664193.324073:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174464 00000100:00100000:0.0:1788664193.324080:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174464 00000100:00100000:0.0:1788664193.324155:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664193.324166:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222174464:12345-0@lo:400: 00000100:00100000:0.0:1788664193.324233:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222174464:12345-0@lo:400: Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.324241:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788664193.324278:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3414a80 x1875550222174464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664193.330407:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222174464:0@lo:400: 00000100:00100000:0.0:1788664193.330551:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174336 00000100:00100000:0.0:1788664193.330564:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174336 00000100:00100000:0.0:1788664193.330657:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788664193.330668:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3307:x1875550222174336:12345-0@lo:400: 00000100:00100000:0.0:1788664193.330840:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3307:x1875550222174336:12345-0@lo:400: Request processed in 173us (10222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664193.330848:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788664193.334148:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3416680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222174336:0@lo:400: 00000100:00100000:3.0:1788664193.335987:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.336124:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174848 00000100:00100000:3.0:1788664193.336137:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174848 00000100:00100000:3.0:1788664193.336225:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664193.336239:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222174848:12345-0@lo:400: 00000100:00080000:0.0:1788664193.336255:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664193.336321:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222174848:12345-0@lo:400: Request processed in 86us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664193.336367:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788664193.336434:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3415180 x1875550222174848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664193.336452:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3415180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222174848:0@lo:400: 00000100:00100000:0.0:1788664193.341511:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664193.341859:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174592 00000100:00100000:3.0:1788664193.341872:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174592 00000100:00100000:3.0:1788664193.341959:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664193.341971:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222174592:12345-0@lo:400: 00000100:00100000:3.0:1788664193.342989:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3415180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222174592:12345-0@lo:400: Request processed in 80us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664193.343010:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788664193.343179:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788664193.343331:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3414e00 x1875550222174592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664193.343562:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222174592:0@lo:400: 00010000:00010000:0.0:1788664193.836788:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664194.336169:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664194.336209:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222174976:0@lo:13: 00000100:00100000:3.0:1788664194.336308:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664194.336422:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222174976 00000100:00100000:3.0:1788664194.336432:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222174976 00000100:00100000:3.0:1788664194.336506:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664194.336518:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222174976:12345-0@lo:13: 00002000:00000024:3.0:1788664194.336573:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664194.336628:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222174976:12345-0@lo:13: Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664194.336636:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788664194.336704:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f9020a80 x1875550222174976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664194.336726:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222174976:0@lo:13: 00010000:00010000:3.0:1788664194.847664:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664195.878767:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788664195.882722:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788664195.882736:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68f8b62000 from 30 10000000:01000000:1.0:1788664195.882744:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788664195.882826:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.882840:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.882855:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664195.882916:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175104:0@lo:101: 00000100:00100000:1.0:1788664195.883025:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.883106:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c583c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.883223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222175104 00000100:00100000:2.0:1788664195.883234:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222175104 00000100:00100000:2.0:1788664195.883312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788664195.883324:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222175104:12345-0@lo:101: 00010000:00010000:2.0:1788664195.883385:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664195.883404:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be900a8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.883434:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be900a8 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.883448:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900a8 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.883460:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215ba00, rc 0) 00000100:00100000:2.0:1788664195.883511:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222175104:12345-0@lo:101: Request processed in 189us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.883519:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788664195.883694:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175104:0@lo:101: 00010000:00010000:3.0:1788664195.883713:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664195.883724:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664195.883795:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175232:0@lo:501: 00000100:00100000:3.0:1788664195.883830:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664195.883866:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.883931:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222175232 00000100:00100000:2.0:1788664195.883936:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222175232 00000100:00100000:2.0:1788664195.883985:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788664195.883992:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222175232:12345-0@lo:501: 00000100:00100000:2.0:1788664195.884460:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222175232:12345-0@lo:501: Request processed in 466us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.884469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788664195.884512:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175232:0@lo:501: 00000100:00100000:2.0:1788664195.884550:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175360:0@lo:503: 00000100:00100000:2.0:1788664195.884611:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.884626:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.884639:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222175360 00000100:00100000:2.0:1788664195.884644:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222175360 00000100:00100000:2.0:1788664195.884662:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788664195.884668:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222175360:12345-0@lo:503: 00000100:00100000:2.0:1788664195.884984:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222175360:12345-0@lo:503: Request processed in 315us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.884992:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788664195.885031:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175360:0@lo:503: 00000100:00100000:2.0:1788664195.885250:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7955:1875550222175488:0@lo:502: 00000100:00100000:2.0:1788664195.885277:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.885292:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222175488 00000100:00100000:2.0:1788664195.885295:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222175488 00000100:00100000:2.0:1788664195.885308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788664195.885312:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7955:x1875550222175488:12345-0@lo:502: 00000100:00100000:2.0:1788664195.885500:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7955:x1875550222175488:12345-0@lo:502: Request processed in 187us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.885513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788664195.885536:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f400c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.885545:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7955:1875550222175488:0@lo:502: 00000100:00100000:2.0:1788664195.885593:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7955:1875550222175616:0@lo:502: 00000100:00100000:2.0:1788664195.885630:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664195.885741:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59a6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.885847:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222175616 00000100:00100000:2.0:1788664195.885853:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222175616 00000100:00100000:2.0:1788664195.885922:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788664195.885929:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7955:x1875550222175616:12345-0@lo:502: 00000100:00100000:2.0:1788664195.886079:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:7955:x1875550222175616:12345-0@lo:502: Request processed in 149us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.886086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788664195.886918:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7955:1875550222175616:0@lo:502: 00000040:00080000:3.0:1788664195.886957:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788664195.893577:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788664195.893646:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788664195.893662:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.893677:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664195.893691:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788664195.893694:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788664195.893697:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788664195.893754:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.893762:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.893776:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664195.893809:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175744:0@lo:101: 00000100:00100000:1.0:1788664195.893910:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.893983:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c583c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.894082:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222175744 00000100:00100000:2.0:1788664195.894092:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222175744 00000100:00100000:2.0:1788664195.894158:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788664195.894169:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222175744:12345-0@lo:101: 00010000:00010000:2.0:1788664195.894186:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664195.894202:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be900b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.894232:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be900b6 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.894244:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900b6 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.894255:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215ac00, rc 0) 00000100:00100000:2.0:1788664195.894317:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222175744:12345-0@lo:101: Request processed in 150us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.894325:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788664195.894493:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175744:0@lo:101: 00010000:00010000:1.0:1788664195.894512:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.894527:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664195.894601:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175872:0@lo:501: 00000100:00100000:1.0:1788664195.894630:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.894660:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c583c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.897654:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222175872 00000100:00100000:2.0:1788664195.897680:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222175872 00000100:00100000:2.0:1788664195.897768:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788664195.897781:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222175872:12345-0@lo:501: 00000100:00100000:2.0:1788664195.898231:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222175872:12345-0@lo:501: Request processed in 452us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.898240:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788664195.898314:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222175872:0@lo:501: 00000100:00100000:2.0:1788664195.898421:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176000:0@lo:503: 00000100:00100000:2.0:1788664195.898479:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.898519:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e37540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.898534:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176000 00000100:00100000:2.0:1788664195.898539:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176000 00000100:00100000:2.0:1788664195.898565:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788664195.898572:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222176000:12345-0@lo:503: 00000100:00100000:2.0:1788664195.898922:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222176000:12345-0@lo:503: Request processed in 349us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.898930:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788664195.898977:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176000:0@lo:503: 00000100:00100000:2.0:1788664195.899256:0:7956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7956:1875550222176128:0@lo:502: 00000100:00100000:2.0:1788664195.899292:0:7956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.899313:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176128 00000100:00100000:2.0:1788664195.899317:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176128 00000100:00100000:2.0:1788664195.899370:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788664195.899377:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:7956:x1875550222176128:12345-0@lo:502: 00000100:00100000:2.0:1788664195.899561:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:7956:x1875550222176128:12345-0@lo:502: Request processed in 183us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.899569:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788664195.899624:0:7956:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e37780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.899638:0:7956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7956:1875550222176128:0@lo:502: 00000020:01000000:2.0:1788664195.899665:0:7956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664195.899680:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664195.899684:0:7956:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788664195.899692:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788664195.899694:0:7956:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788664195.899711:0:7956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7956:1875550222176256:0@lo:502: 00000100:00100000:2.0:1788664195.899747:0:7956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.899768:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176256 00000100:00100000:2.0:1788664195.899773:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176256 00000100:00100000:2.0:1788664195.899795:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788664195.899801:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:7956:x1875550222176256:12345-0@lo:502: 00000100:00100000:2.0:1788664195.899916:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:7956:x1875550222176256:12345-0@lo:502: Request processed in 111us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.899924:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788664195.899956:0:7956:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e37780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.899968:0:7956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7956:1875550222176256:0@lo:502: 00000020:01000000:2.0:1788664195.899985:0:7956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664195.899990:0:7956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664195.899992:0:7956:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788664195.899995:0:7956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788664195.900068:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788664195.900095:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788664195.900107:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.900119:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664195.900130:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788664195.900133:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68d438d000 from 30 10000000:01000000:2.0:1788664195.900136:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664195.900166:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.900175:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.900185:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664195.900197:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176384:0@lo:101: 00000100:00100000:2.0:1788664195.900223:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.900236:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.900248:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176384 00000100:00100000:2.0:1788664195.900252:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176384 00000100:00100000:2.0:1788664195.900271:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788664195.900278:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222176384:12345-0@lo:101: 00010000:00010000:2.0:1788664195.900287:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664195.900303:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be900c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.900372:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be900c4 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.900386:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900c4 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.900396:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215b800, rc 0) 00000100:00100000:2.0:1788664195.900427:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222176384:12345-0@lo:101: Request processed in 149us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.900433:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788664195.900464:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176384:0@lo:101: 00010000:00010000:2.0:1788664195.900478:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.900488:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664195.900533:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176512:0@lo:501: 00000100:00100000:2.0:1788664195.900558:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.900572:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e37c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.900583:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176512 00000100:00100000:2.0:1788664195.905693:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176512 00000100:00100000:2.0:1788664195.905820:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788664195.905833:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222176512:12345-0@lo:501: 00000100:00100000:2.0:1788664195.906294:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222176512:12345-0@lo:501: Request processed in 461us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.906305:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788664195.906438:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176512:0@lo:501: 00000100:00100000:2.0:1788664195.906507:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176640:0@lo:503: 00000100:00100000:2.0:1788664195.906568:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.906624:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e37c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.906643:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176640 00000100:00100000:2.0:1788664195.906650:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176640 00000100:00100000:2.0:1788664195.906683:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788664195.906692:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222176640:12345-0@lo:503: 00000100:00100000:2.0:1788664195.906876:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222176640:12345-0@lo:503: Request processed in 185us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.906883:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788664195.906922:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222176640:0@lo:503: 00000100:00100000:3.0:1788664195.921696:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7957:1875550222176768:0@lo:502: 00000100:00100000:3.0:1788664195.923114:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664195.923168:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.923260:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176768 00000100:00100000:2.0:1788664195.923272:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176768 00000100:00100000:2.0:1788664195.923405:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788664195.923417:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:7957:x1875550222176768:12345-0@lo:502: 00000100:00100000:2.0:1788664195.923777:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:7957:x1875550222176768:12345-0@lo:502: Request processed in 361us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.923786:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788664195.923996:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7957:1875550222176768:0@lo:502: 00000100:00100000:3.0:1788664195.924084:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7957:1875550222176896:0@lo:502: 00000100:00100000:3.0:1788664195.924139:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664195.924179:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.925992:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222176896 00000100:00100000:2.0:1788664195.926015:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222176896 00000100:00100000:2.0:1788664195.926106:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788664195.926119:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:7957:x1875550222176896:12345-0@lo:502: 00000100:00100000:2.0:1788664195.929053:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:7957:x1875550222176896:12345-0@lo:502: Request processed in 2924us (4899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.929074:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788664195.929387:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7957:1875550222176896:0@lo:502: 00000040:00080000:3.0:1788664195.929439:0:7957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788664195.935689:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788664195.935736:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664195.935750:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.935777:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664195.935790:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664195.935793:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68d438d000 from 5 10000000:01000000:2.0:1788664195.935797:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664195.935854:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.935863:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.935876:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664195.935907:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177024:0@lo:101: 00000100:00100000:2.0:1788664195.935991:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.936044:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c91dccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.936070:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177024 00000100:00100000:2.0:1788664195.936079:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177024 00000100:00100000:2.0:1788664195.936157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788664195.936168:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222177024:12345-0@lo:101: 00010000:00010000:2.0:1788664195.936184:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664195.936201:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b690215b400/0x762f55027be900d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be900d2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.936239:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b690215b400/0x762f55027be900d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be900d2 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.936251:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b690215b400/0x762f55027be900d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900d2 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.936260:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215b400, rc 0) 00000100:00100000:2.0:1788664195.936307:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222177024:12345-0@lo:101: Request processed in 141us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.936315:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788664195.936389:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177024:0@lo:101: 00010000:00010000:2.0:1788664195.936408:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.936418:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664195.936468:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177152:0@lo:256: 00000100:00100000:2.0:1788664195.936502:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.936531:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c91dccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664195.936625:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177152 00000100:00100000:0.0:1788664195.936631:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177152 00000100:00100000:0.0:1788664195.936666:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788664195.936679:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222177152:12345-0@lo:256: 20000000:01000000:0.0:1788664195.936696:0:5849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788664195.936718:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788664195.936721:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788664195.936806:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222177152:12345-0@lo:256: Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664195.936814:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788664195.936859:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177152:0@lo:256: 10000000:01000000:2.0:1788664195.936904:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788664195.936911:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.936920:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664195.936938:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788664195.936940:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788664195.936942:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664195.936961:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.936968:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.936977:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664195.936990:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177280:0@lo:101: 00000100:00100000:2.0:1788664195.937017:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664195.937038:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c91dccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664195.937078:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177280 00000100:00100000:0.0:1788664195.937084:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177280 00000100:00100000:0.0:1788664195.937115:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788664195.937122:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222177280:12345-0@lo:101: 00010000:00010000:0.0:1788664195.937132:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664195.937145:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be900e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664195.937160:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be900e0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664195.937176:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900e0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664195.937182:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef600, rc 0) 00000100:00100000:0.0:1788664195.937221:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222177280:12345-0@lo:101: Request processed in 99us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664195.937226:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788664195.937896:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177280:0@lo:101: 00010000:00010000:1.0:1788664195.937915:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.937925:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664195.937987:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177408:0@lo:501: 00000100:00100000:1.0:1788664195.938024:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.938066:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c583c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664195.938173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177408 00000100:00100000:0.0:1788664195.938179:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177408 00000100:00100000:0.0:1788664195.938224:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788664195.938234:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222177408:12345-0@lo:501: 00000100:00100000:1.0:1788664195.946234:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222177408:12345-0@lo:501: Request processed in 7986us (8193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.946252:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788664195.946590:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177408:0@lo:501: 00000100:00100000:3.0:1788664195.946699:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177536:0@lo:503: 00000100:00100000:3.0:1788664195.946781:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664195.946833:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664195.946977:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177536 00000100:00100000:1.0:1788664195.946985:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177536 00000100:00100000:1.0:1788664195.947047:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788664195.947058:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222177536:12345-0@lo:503: 00000100:00100000:1.0:1788664195.947489:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222177536:12345-0@lo:503: Request processed in 432us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.947499:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788664195.947556:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222177536:0@lo:503: 00000100:00100000:1.0:1788664195.947824:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7958:1875550222177664:0@lo:502: 00000100:00100000:1.0:1788664195.947866:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.947890:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177664 00000100:00100000:1.0:1788664195.947896:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177664 00000100:00100000:1.0:1788664195.947924:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788664195.947932:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:7958:x1875550222177664:12345-0@lo:502: 00000100:00100000:1.0:1788664195.948169:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:7958:x1875550222177664:12345-0@lo:502: Request processed in 236us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.948177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788664195.948219:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c583c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664195.948232:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7958:1875550222177664:0@lo:502: 00000020:01000000:1.0:1788664195.948254:0:7958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788664195.948265:0:7958:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788664195.948274:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664195.948277:0:7958:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788664195.948283:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788664195.948287:0:7958:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:1.0:1788664195.948317:0:7958:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788664195.948320:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664195.948366:0:7958:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b68f8188000) 00000020:00000080:1.0:1788664195.948396:0:7958:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788664195.948403:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788664195.948485:0:7958:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788664195.948492:0:7958:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788664195.948499:0:7958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be900f5 00010000:00080000:1.0:1788664195.948537:0:7958:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b68fb58b800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788664195.948818:0:7958:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788664195.949207:0:7958:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788664195.949221:0:7958:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788664195.949834:0:7958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664195.950060:0:7958:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664195.950118:0:7958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788664195.950181:0:7958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788664195.958843:0:7959:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664195.958855:0:7959:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788664195.967780:0:7958:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788664195.967815:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788664195.967856:0:7958:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788664195.967886:0:7958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be900fc 00000100:00080000:3.0:1788664195.967900:0:7958:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664195.967907:0:7958:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b68fb58b800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664195.967962:0:7958:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68f9022a00 x1875550222177792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664195.967998:0:7958:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788664195.968067:0:7958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664195.968072:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664195.968075:0:7958:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788664195.968078:0:7958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664195.968083:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664195.968084:0:7958:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788664195.968088:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664195.968090:0:7958:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788664195.968124:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7958:1875550222177920:0@lo:502: 00000100:00100000:3.0:1788664195.968237:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664195.968279:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664195.968453:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222177792:0@lo:8: 00000100:00100000:3.0:1788664195.968493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664195.968537:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177792 00000100:00100000:3.0:1788664195.968551:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177792 00000100:00100000:3.0:1788664195.968590:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664195.968599:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875550222177792:12345-0@lo:8: 00010000:00080000:3.0:1788664195.968630:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1788664195.968674:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be90103 00002000:00100000:3.0:1788664195.968693:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b68f85d8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788664195.968698:0:6697:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788664195.968703:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788664195.968883:0:6697:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788664195.969052:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788664195.969090:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b68f85db800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664195.969161:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875550222177792:12345-0@lo:8: Request processed in 560us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664195.969169:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788664195.969217:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f9022a00 x1875550222177792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664195.969228:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788664195.969237:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788664195.969245:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788664195.969251:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788664195.969254:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68fb58b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788664195.969265:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788664195.969271:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222177792:0@lo:8: 00000004:00080000:3.0:1788664195.969301:0:7959:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788664195.969467:0:7959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 229953124259ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788664195.969762:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222177920 00000100:00100000:1.0:1788664195.969768:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222177920 00000100:00100000:1.0:1788664195.969821:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664195.969831:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:7958:x1875550222177920:12345-0@lo:502: 00000100:00100000:1.0:1788664195.970117:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:7958:x1875550222177920:12345-0@lo:502: Request processed in 288us (1880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.970126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664195.970203:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222178432:0@lo:400: 00000100:00100000:1.0:1788664195.970244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.970271:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664195.970277:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222178048:0@lo:400: 00000100:00100000:1.0:1788664195.970298:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.970327:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222178176:0@lo:400: 00000100:00100000:1.0:1788664195.970397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.970417:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664195.970423:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222178304:0@lo:400: 00000100:00100000:1.0:1788664195.970448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.970794:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178432 00000100:00100000:1.0:1788664195.970801:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178432 00000100:00100000:1.0:1788664195.970848:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178048 00000100:00100000:1.0:1788664195.970851:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178048 00000100:00100000:1.0:1788664195.970863:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178176 00000100:00100000:1.0:1788664195.970866:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178176 00000100:00100000:1.0:1788664195.970895:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664195.970902:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222178432:12345-0@lo:400: 00000100:00100000:1.0:1788664195.970948:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222178432:12345-0@lo:400: Request processed in 47us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.970954:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664195.970967:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664195.970972:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222178048:12345-0@lo:400: 00000100:00100000:1.0:1788664195.971000:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222178048:12345-0@lo:400: Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.971006:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664195.971018:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664195.971024:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222178176:12345-0@lo:400: 00000100:00100000:1.0:1788664195.971054:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222178176:12345-0@lo:400: Request processed in 30us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.971059:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788664195.971109:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fed80 x1875550222178176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664195.971124:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222178176:0@lo:400: 00010000:00080000:1.0:1788664195.971152:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fc000 x1875550222178048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664195.971161:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222178048:0@lo:400: 00010000:00080000:1.0:1788664195.971169:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fdf80 x1875550222178432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664195.971176:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222178432:0@lo:400: 00000100:00100000:1.0:1788664195.971867:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:7958:1875550222177920:0@lo:502: 00000020:01000000:1.0:1788664195.971909:0:7958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664195.971919:0:7958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664195.971922:0:7958:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788664195.971927:0:7958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788664195.972009:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788664195.972029:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788664195.972042:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.972055:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664195.972068:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788664195.972071:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff9b68c3f919c0 from 1 10000000:01000000:1.0:1788664195.972074:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788664195.972113:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.972121:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.972132:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664195.972155:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222178560:0@lo:101: 00000100:00100000:1.0:1788664195.972210:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.972250:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d1b88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664195.972267:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178560 00000100:00100000:1.0:1788664195.972282:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178560 00000100:00100000:1.0:1788664195.972323:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788664195.972332:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222178560:12345-0@lo:101: 00010000:00010000:1.0:1788664195.972371:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664195.972387:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9010a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.972412:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9010a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.972424:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9010a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.972435:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479400, rc 0) 00000100:00100000:1.0:1788664195.972469:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222178560:12345-0@lo:101: Request processed in 138us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664195.972476:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788664195.972535:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222178560:0@lo:101: 00010000:00010000:1.0:1788664195.972549:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664195.972559:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664195.972609:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222178688:0@lo:501: 00000100:00100000:2.0:1788664195.973235:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178304 00000100:00100000:2.0:1788664195.973242:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178304 00000100:00100000:2.0:1788664195.973289:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664195.973299:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222178304:12345-0@lo:400: 00000100:00100000:2.0:1788664195.973377:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222178304:12345-0@lo:400: Request processed in 79us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664195.973383:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788664195.973411:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664195.973416:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788664195.973542:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fd500 x1875550222178304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664195.973557:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222178304:0@lo:400: 00000100:00100000:1.0:1788664195.987978:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664195.988433:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664195.989553:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178688 00000100:00100000:2.0:1788664195.989574:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178688 00000100:00100000:2.0:1788664195.989642:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788664195.989666:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222178688:12345-0@lo:501: 00000100:00100000:2.0:1788664195.990092:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222178688:12345-0@lo:501: Request processed in 439us (17452us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664195.990103:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788664195.990204:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222178688:0@lo:501: 10000000:01000000:2.0:1788664195.990250:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788664195.990264:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664195.990276:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664196.070096:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788664196.171022:0:7960:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788664196.171067:0:7960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222178944:0@lo:7: 00000100:00100000:3.0:1788664196.171190:0:7960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664196.171260:0:7960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c894d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664196.171285:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178944 00000100:00100000:3.0:1788664196.171294:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178944 00000100:00100000:3.0:1788664196.171396:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664196.171407:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7960:x1875550222178944:12345-0@lo:7: 00000100:00100000:2.0:1788664196.173904:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222178816:0@lo:13: 00000100:00100000:2.0:1788664196.174011:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788664196.190080:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664196.210402:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222178816 00000100:00100000:3.0:1788664196.210423:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222178816 00000100:00100000:3.0:1788664196.210509:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664196.210522:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875550222178816:12345-0@lo:13: 00002000:00000024:3.0:1788664196.210564:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788664196.210687:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875550222178816:12345-0@lo:13: Request processed in 167us (36675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664196.210695:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788664196.210783:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f9022a00 x1875550222178816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664196.210825:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222178816:0@lo:13: 00002000:00080000:3.0:1788664196.214513:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788664196.214524:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788664196.214660:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7960:x1875550222178944:12345-0@lo:7: Request processed in 43247us (43462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664196.214674:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788664196.214753:0:7960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f9020e00 x1875550222178944/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788664212 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664196.214773:0:7960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222178944:0@lo:7: 00000004:00080000:3.0:1788664196.214793:0:7960:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788664196.214864:0:7960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222179072:0@lo:5: 00000100:00100000:3.0:1788664196.214933:0:7960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664196.219958:0:7960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c894d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664196.220111:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179072 00000100:00100000:3.0:1788664196.220125:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179072 00000100:00100000:3.0:1788664196.220219:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664196.220232:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7960:x1875550222179072:12345-0@lo:5: 00002000:00080000:3.0:1788664196.220277:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788664196.220281:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788664196.226235:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7960:x1875550222179072:12345-0@lo:5: Request processed in 5986us (11282us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788664196.226258:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788664196.226389:0:7960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612dc00 x1875550222179072/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664212 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664196.226411:0:7960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222179072:0@lo:5: 00000004:00080000:3.0:1788664196.226433:0:7960:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788664196.226498:0:7960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222179200:0@lo:700: 00000100:00100000:3.0:1788664196.226571:0:7960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664196.226624:0:7960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c894d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664196.226653:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179200 00000100:00100000:3.0:1788664196.226661:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179200 00000100:00100000:3.0:1788664196.226712:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664196.226724:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7960:x1875550222179200:12345-0@lo:700: 00000100:00100000:3.0:1788664196.226772:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1875550222179328:0@lo:700: 00000100:00100000:3.0:1788664196.226804:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664196.226837:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c894d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664196.226859:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179328 00000100:00100000:3.0:1788664196.226880:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179328 00000100:00100000:3.0:1788664196.226910:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664196.226917:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1875550222179328:12345-0@lo:700: 40000000:02000000:2.0:1788664196.346548:0:5861:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788664196.365233:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6703:x1875550222179328:12345-0@lo:700: Request processed in 138302us (138413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664196.365253:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788664196.365413:0:6703:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612e680 x1875550222179328/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788664212 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664196.365457:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6703:1875550222179328:0@lo:700: 40000000:02000000:1.0:1788664196.365474:0:6703:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1788664196.628060:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788664196.628077:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788664196.635580:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7960:x1875550222179200:12345-0@lo:700: Request processed in 408846us (408996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664196.635603:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788664196.635783:0:7960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612df80 x1875550222179200/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788664212 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664196.635797:0:7960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788664196.635814:0:7960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222179200:0@lo:700: 00000004:02000040:1.0:1788664196.759016:0:7960:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788664196.776680:0:7960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222179456:0@lo:5: 00000100:00100000:1.0:1788664196.776790:0:7960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664196.777959:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179456 00000100:00100000:1.0:1788664196.777973:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179456 00000100:00100000:1.0:1788664196.778048:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664196.778061:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7960:x1875550222179456:12345-0@lo:5: 00000100:00100000:0.0:1788664196.786477:0:7960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c300 going to sleep for 11 seconds 00002000:00080000:1.0:1788664196.814196:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788664196.815561:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788664196.834823:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7960:x1875550222179456:12345-0@lo:5: Request processed in 56755us (58024us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788664196.834839:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788664196.837950:0:7960:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fc000 x1875550222179456/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788664212 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664196.837979:0:7960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7960:1875550222179456:0@lo:5: 00000004:00080000:3.0:1788664196.838001:0:7960:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788664196.895738:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788664196.897107:0:8005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788664197.919585:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664198.944545:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664199.457677:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222179584:0@lo:13: 00000100:00100000:2.0:1788664199.457795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664199.458263:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179584 00000100:00100000:3.0:1788664199.458275:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179584 00000100:00100000:3.0:1788664199.458395:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664199.458408:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222179584:12345-0@lo:13: 00002000:00000024:3.0:1788664199.458463:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664199.458528:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222179584:12345-0@lo:13: Request processed in 123us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664199.458538:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788664199.458611:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664199.458652:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612d880 x1875550222179584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664199.458699:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222179584:0@lo:13: 00010000:00010000:0.0:1788664199.974013:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664200.992710:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222180096:0@lo:400: 00000100:00100000:2.0:1788664200.992876:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222179712:0@lo:400: 00000100:00100000:2.0:1788664200.992951:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664200.993014:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222180224:0@lo:400: 00010000:00010000:3.0:1788664200.993232:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664200.993244:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222179968:0@lo:400: 00000100:00100000:1.0:1788664200.993416:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664200.993456:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222179840:0@lo:400: 00000100:00100000:1.0:1788664200.993488:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179712 00000100:00100000:1.0:1788664200.993495:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179712 00000100:00100000:1.0:1788664200.993543:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788664200.993552:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222179712:12345-0@lo:400: 00000100:00100000:1.0:1788664200.993601:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222179712:12345-0@lo:400: Request processed in 50us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664200.993607:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788664200.993688:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664200.993877:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180096 00000100:00100000:3.0:1788664200.993881:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180096 00000100:00100000:3.0:1788664200.993914:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664200.993920:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222180096:12345-0@lo:400: 00000100:00100000:2.0:1788664200.994970:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222179712:0@lo:400: 00000100:00100000:1.0:1788664200.995909:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180224 00000100:00100000:1.0:1788664200.995920:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180224 00000100:00100000:1.0:1788664200.995992:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664200.996003:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222180224:12345-0@lo:400: 00000100:00100000:3.0:1788664200.996389:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222180096:12345-0@lo:400: Request processed in 2466us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664200.996406:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664200.996447:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664200.996488:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179968 00000100:00100000:3.0:1788664200.996492:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179968 00000100:00100000:3.0:1788664200.996517:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664200.996523:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222179968:12345-0@lo:400: 00000100:00100000:3.0:1788664200.996559:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222179968:12345-0@lo:400: Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664200.996565:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788664200.996597:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fd500 x1875550222179968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664200.996610:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222179968:0@lo:400: 00000100:00100000:1.0:1788664200.996916:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222180224:12345-0@lo:400: Request processed in 914us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664200.996923:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664200.996947:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664200.996972:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222180352:0@lo:400: 00000100:00100000:1.0:1788664200.997005:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788664200.997410:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f80de680 x1875550222180096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664200.997422:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222180096:0@lo:400: 00000100:00080000:1.0:1788664200.997500:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664200.997514:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222179840 00000100:00100000:1.0:1788664200.997519:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222179840 00000100:00100000:1.0:1788664200.999233:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664200.999253:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222179840:12345-0@lo:400: 00000100:00100000:1.0:1788664200.999351:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222179840:12345-0@lo:400: Request processed in 94us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664200.999359:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788664201.003919:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f80dfb80 x1875550222180224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664201.003940:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222180224:0@lo:400: 00000100:00100000:2.0:1788664201.005000:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180352 00000100:00100000:2.0:1788664201.005011:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180352 00000100:00100000:2.0:1788664201.005087:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788664201.005096:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222180352:12345-0@lo:400: 00000100:00080000:3.0:1788664201.005559:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664201.005655:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222180352:12345-0@lo:400: Request processed in 559us (8647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664201.005662:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788664201.005705:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fdf80 x1875550222179840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664201.005717:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222179840:0@lo:400: 00010000:00080000:2.0:1788664201.005742:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f80dd880 x1875550222180352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664201.005762:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222180352:0@lo:400: 00000100:00100000:1.0:1788664201.504493:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222180480:0@lo:13: 00000100:00100000:1.0:1788664201.504589:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664201.504723:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180480 00000100:00100000:3.0:1788664201.504731:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180480 00000100:00100000:3.0:1788664201.504782:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664201.504792:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222180480:12345-0@lo:13: 00002000:00000024:3.0:1788664201.504832:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664201.504896:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222180480:12345-0@lo:13: Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664201.504903:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788664201.504942:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612d180 x1875550222180480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664201.504961:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222180480:0@lo:13: 00000001:00080000:1.0:1788664201.684103:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788664202.015745:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664203.039818:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664203.982741:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664203.983060:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204330112 00000100:00100000:2.0:1788664203.983072:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204330112 00000100:00100000:2.0:1788664203.983121:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:2.0:1788664203.983130:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2357:x1875550204330112:12345-192.168.202.14@tcp:250: 00010000:00080000:2.0:1788664203.983162:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c@192.168.202.14@tcp t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1788664203.983197:0:5849:0:(genops.c:1385:class_connect()) connect: client e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c, cookie 0x762f55027be90118 00000100:00080000:2.0:1788664203.983376:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9b67c510b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664203.983465:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+5:2357:x1875550204330112:12345-192.168.202.14@tcp:250: Request processed in 334us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664203.983473:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:2.0:1788664203.990985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664203.991110:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204330240 00000100:00100000:3.0:1788664203.991123:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204330240 00000100:00100000:3.0:1788664203.991196:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 114 00000100:00100000:3.0:1788664203.991207:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+5:5588:x1875550204330240:12345-192.168.202.14@tcp:101: 00010000:00010000:3.0:1788664203.991228:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664203.991258:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243601 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664203.991298:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664203.991312:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664203.991322:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b400, rc 0) 00000100:00100000:3.0:1788664203.991624:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+6:5588:x1875550204330240:12345-192.168.202.14@tcp:101: Request processed in 417us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664203.991633:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 114 00000100:00100000:1.0:1788664204.018251:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.018363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204330368 00000100:00100000:3.0:1788664204.018375:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204330368 00000100:00100000:3.0:1788664204.018444:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:3.0:1788664204.018455:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+6:5588:x1875550204330368:12345-192.168.202.14@tcp:501: 00000100:00100000:3.0:1788664204.019048:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+6:5588:x1875550204330368:12345-192.168.202.14@tcp:501: Request processed in 593us (805us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664204.019057:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:3.0:1788664204.022509:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664204.023016:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204330496 00000100:00100000:1.0:1788664204.023028:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204330496 00000100:00100000:1.0:1788664204.023084:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:1.0:1788664204.023094:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+6:5588:x1875550204330496:12345-192.168.202.14@tcp:101: 00010000:00010000:1.0:1788664204.023111:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664204.023130:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243608 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664204.023449:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664204.023467:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664204.023478:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479000, rc 0) 00000100:00100000:1.0:1788664204.023539:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+7:5588:x1875550204330496:12345-192.168.202.14@tcp:101: Request processed in 448us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664204.023547:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:1.0:1788664204.026067:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.026155:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204330624 00000100:00100000:3.0:1788664204.026284:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204330624 00000100:00100000:1.0:1788664204.026483:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:1.0:1788664204.026498:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+7:5588:x1875550204330624:12345-192.168.202.14@tcp:501: 00000100:00100000:1.0:1788664204.027291:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5588:x1875550204330624:12345-192.168.202.14@tcp:501: Request processed in 792us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664204.027302:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:1.0:1788664204.040713:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.040869:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204330752 00000100:00100000:3.0:1788664204.040881:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204330752 00000100:00100000:3.0:1788664204.041061:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:3.0:1788664204.041074:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5588:x1875550204330752:12345-192.168.202.14@tcp:503: 00000100:00100000:3.0:1788664204.041571:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5588:x1875550204330752:12345-192.168.202.14@tcp:503: Request processed in 497us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664204.041581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 118 00010000:00010000:2.0:1788664204.063878:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664204.065761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664204.066088:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204330880 00000100:00100000:1.0:1788664204.066101:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204330880 00000100:00100000:1.0:1788664204.066225:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:1.0:1788664204.066236:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5606:x1875550204330880:12345-192.168.202.14@tcp:502: 00000100:00100000:1.0:1788664204.066677:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5606:x1875550204330880:12345-192.168.202.14@tcp:502: Request processed in 439us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664204.066686:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:1.0:1788664204.089175:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664204.090932:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331008 00000100:00100000:2.0:1788664204.090949:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331008 00000100:00100000:2.0:1788664204.091031:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:2.0:1788664204.091042:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5606:x1875550204331008:12345-192.168.202.14@tcp:502: 00000100:00100000:2.0:1788664204.092918:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5606:x1875550204331008:12345-192.168.202.14@tcp:502: Request processed in 1869us (3744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664204.092930:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:3.0:1788664204.098829:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664204.099162:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331136 00000100:00100000:0.0:1788664204.099175:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331136 00000100:00100000:0.0:1788664204.099232:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:0.0:1788664204.099256:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5588:x1875550204331136:12345-192.168.202.14@tcp:101: 00010000:00010000:0.0:1788664204.099276:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664204.099298:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ef000/0x762f55027be9012d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243632 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664204.099364:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ef000/0x762f55027be9012d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243632 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664204.099375:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ef000/0x762f55027be9012d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243632 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664204.099384:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef000, rc 0) 00000100:00100000:0.0:1788664204.099443:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5588:x1875550204331136:12345-192.168.202.14@tcp:101: Request processed in 190us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664204.099450:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:0.0:1788664204.105545:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664204.105580:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331264 00000100:00100000:0.0:1788664204.105589:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331264 00000100:00100000:0.0:1788664204.105641:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:0.0:1788664204.105652:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5588:x1875550204331264:12345-192.168.202.14@tcp:256: 20000000:01000000:0.0:1788664204.105680:0:5847:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788664204.105702:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788664204.105706:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788664204.105710:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788664204.105713:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788664204.114701:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5588:x1875550204331264:12345-192.168.202.14@tcp:256: Request processed in 9038us (9152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664204.114718:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:0.0:1788664204.119710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.120152:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331392 00000100:00100000:3.0:1788664204.120163:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331392 00000100:00100000:3.0:1788664204.120214:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:3.0:1788664204.120223:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5588:x1875550204331392:12345-192.168.202.14@tcp:101: 00010000:00010000:3.0:1788664204.120244:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664204.120274:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243639 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664204.120305:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664204.120319:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664204.120329:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b800, rc 0) 00000100:00100000:3.0:1788664204.120639:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5588:x1875550204331392:12345-192.168.202.14@tcp:101: Request processed in 414us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664204.120647:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:0.0:1788664204.134747:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664204.134832:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331520 00000100:00100000:2.0:1788664204.134853:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331520 00000100:00100000:2.0:1788664204.134908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:2.0:1788664204.134917:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5588:x1875550204331520:12345-192.168.202.14@tcp:501: 00000100:00100000:2.0:1788664204.135457:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5588:x1875550204331520:12345-192.168.202.14@tcp:501: Request processed in 539us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664204.135466:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:1.0:1788664204.140091:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664204.140686:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331648 00000100:00100000:0.0:1788664204.140696:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331648 00000100:00100000:0.0:1788664204.140753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:0.0:1788664204.140764:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5588:x1875550204331648:12345-192.168.202.14@tcp:503: 00000100:00100000:0.0:1788664204.141581:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5588:x1875550204331648:12345-192.168.202.14@tcp:503: Request processed in 815us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664204.141591:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:3.0:1788664204.148989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664204.152204:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331776 00000100:00100000:0.0:1788664204.152224:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331776 00000100:00100000:0.0:1788664204.152309:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:0.0:1788664204.152331:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5611:x1875550204331776:12345-192.168.202.14@tcp:502: 00000100:00100000:0.0:1788664204.152834:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5611:x1875550204331776:12345-192.168.202.14@tcp:502: Request processed in 513us (3853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664204.153640:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:1.0:1788664204.156336:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664204.156678:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204331904 00000100:00100000:2.0:1788664204.156689:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204331904 00000100:00100000:2.0:1788664204.156745:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:2.0:1788664204.156756:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5611:x1875550204331904:12345-192.168.202.14@tcp:502: 00000100:00100000:2.0:1788664204.157215:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5611:x1875550204331904:12345-192.168.202.14@tcp:502: Request processed in 459us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664204.157225:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:1.0:1788664204.170244:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.170732:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332032 00000100:00100000:3.0:1788664204.170757:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332032 00000100:00100000:3.0:1788664204.170814:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788664204.170823:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875550204332032:12345-192.168.202.14@tcp:38: 00010000:00080000:3.0:1788664204.170867:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1788664204.170922:0:5855:0:(genops.c:1385:class_connect()) connect: client 5e600724-38bd-4119-be7d-5264f08f0aa5, cookie 0x762f55027be9013b 00000004:00100000:3.0:1788664204.170953:0:5855:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b6 00000001:00000004:3.0:1788664204.170960:0:5855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788664204.220272:0:5855:0:(import.c:65:import_set_state_nolock()) ffff9b68f85df000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664204.220588:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2357:x1875550204332032:12345-192.168.202.14@tcp:38: Request processed in 49763us (50352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664204.220600:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:1.0:1788664204.575778:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664204.576244:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222180608:0@lo:13: 00000100:00100000:1.0:1788664204.576394:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664204.576899:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180608 00000100:00100000:3.0:1788664204.576907:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180608 00000100:00100000:3.0:1788664204.577013:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664204.577024:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222180608:12345-0@lo:13: 00002000:00000024:3.0:1788664204.577080:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664204.577139:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222180608:12345-0@lo:13: Request processed in 117us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664204.577147:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788664204.577233:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612d180 x1875550222180608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664204.577255:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222180608:0@lo:13: 00000100:00080000:1.0:1788664204.577891:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664204.987164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.987400:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332288 00000100:00100000:3.0:1788664204.987410:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332288 00000100:00100000:3.0:1788664204.987484:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788664204.987495:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5588:x1875550204332288:12345-192.168.202.14@tcp:41: 00000004:00000024:3.0:1788664204.987543:0:7653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788664204.987632:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5588:x1875550204332288:12345-192.168.202.14@tcp:41: Request processed in 138us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664204.987640:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00080000:1.0:1788664204.987870:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664204.988808:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664204.989036:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332160 00000100:00100000:2.0:1788664204.989046:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332160 00000100:00100000:2.0:1788664204.989095:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788664204.989114:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:0:x1875550204332160:12345-192.168.202.14@tcp:41: 00000004:00000024:2.0:1788664204.989151:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788664204.989217:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:0:x1875550204332160:12345-192.168.202.14@tcp:41: Request processed in 104us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664204.989224:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788664204.991883:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.992055:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332416 00000100:00100000:3.0:1788664204.992067:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332416 00000100:00100000:3.0:1788664204.992140:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788664204.992163:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5588:x1875550204332416:12345-192.168.202.14@tcp:40: 00000100:00100000:3.0:1788664204.992447:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5588:x1875550204332416:12345-192.168.202.14@tcp:40: Request processed in 285us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664204.992455:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788664204.996197:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664204.996490:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332544 00000100:00100000:3.0:1788664204.996502:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332544 00000100:00100000:3.0:1788664204.996573:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788664204.996583:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875550204332544:12345-192.168.202.14@tcp:8: 00010000:00080000:3.0:1788664204.996622:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1788664204.996661:0:6696:0:(genops.c:1385:class_connect()) connect: client 5e600724-38bd-4119-be7d-5264f08f0aa5, cookie 0x762f55027be90142 00002000:00100000:3.0:1788664204.996674:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5e600724-38bd-4119-be7d-5264f08f0aa5/ffff9b68f85da000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788664204.996686:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b6 00002000:00080000:3.0:1788664204.997589:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788664204.997630:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b68f85de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664205.001472:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2357:x1875550204332544:12345-192.168.202.14@tcp:8: Request processed in 4874us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664205.001490:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788664205.003435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664205.004098:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332672 00000100:00100000:2.0:1788664205.004119:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332672 00000100:00100000:2.0:1788664205.004191:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:2.0:1788664205.004202:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2359:x1875550204332672:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788664205.004287:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2359:x1875550204332672:12345-192.168.202.14@tcp:400: Request processed in 87us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664205.004296:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:0.0:1788664205.009465:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664205.009541:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664205.009797:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332928 00000100:00100000:2.0:1788664205.009809:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332928 00000100:00100000:2.0:1788664205.009866:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788664205.009877:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5588:x1875550204332928:12345-192.168.202.14@tcp:33: 00000100:00100000:2.0:1788664205.009990:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204332800 00000100:00100000:2.0:1788664205.009993:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204332800 00000100:00100000:2.0:1788664205.010021:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788664205.010026:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875550204332800:12345-192.168.202.14@tcp:8: 00010000:00080000:2.0:1788664205.010056:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1788664205.010094:0:6694:0:(genops.c:1385:class_connect()) connect: client 5e600724-38bd-4119-be7d-5264f08f0aa5, cookie 0x762f55027be90149 00002000:00100000:2.0:1788664205.010109:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5e600724-38bd-4119-be7d-5264f08f0aa5/ffff9b68f8b60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664205.010154:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b6 00002000:00080000:2.0:1788664205.010803:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788664205.010840:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b68f808c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664205.010922:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2357:x1875550204332800:12345-192.168.202.14@tcp:8: Request processed in 893us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664205.010931:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000004:00080000:0.0:1788664205.037217:0:5857:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27249us 00000004:00200000:0.0:1788664205.065721:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788664205.065860:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5588:x1875550204332928:12345-192.168.202.14@tcp:33: Request processed in 55979us (56401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664205.065874:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00010000:00010000:0.0:1788664205.087607:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664205.400987:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664205.401148:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333056 00000100:00100000:3.0:1788664205.401160:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333056 00000100:00100000:3.0:1788664205.401241:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788664205.401252:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5628:x1875550204333056:12345-192.168.202.14@tcp:101: 00010000:00010000:3.0:1788664205.401276:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664205.401304:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243663 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664205.401434:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ba00/0x762f55027be90157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664205.401448:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ba00/0x762f55027be90157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664205.401467:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ba00/0x762f55027be90157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664205.401504:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788664205.401509:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664205.401526:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ba00/0x762f55027be90157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664205.401553:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243663 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664205.401573:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ba00/0x762f55027be90157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243663 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664205.401582:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664205.401585:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664205.401589:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147ba00, rc 0) 00000100:00100000:3.0:1788664205.401655:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:5628:x1875550204333056:12345-192.168.202.14@tcp:101: Request processed in 404us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664205.401662:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788664206.111561:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664206.111597:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222180736:0@lo:400: 00000100:00100000:2.0:1788664206.111679:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222180992:0@lo:400: 00000100:00100000:3.0:1788664206.111705:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664206.111729:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664206.111781:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222181120:0@lo:400: 00000100:00100000:0.0:1788664206.111809:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222180864:0@lo:400: 00000100:00100000:3.0:1788664206.111829:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664206.111847:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664206.111858:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664206.111868:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222181248:0@lo:400: 00000100:00100000:0.0:1788664206.111877:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222181376:0@lo:400: 00000100:00100000:3.0:1788664206.111910:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664206.111916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664206.111950:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664206.111965:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180992 00000100:00100000:3.0:1788664206.111966:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180864 00000100:00100000:3.0:1788664206.111973:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180864 00000100:00100000:0.0:1788664206.111985:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180992 00000100:00100000:3.0:1788664206.112018:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222181248 00000100:00100000:3.0:1788664206.112023:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222181248 00000100:00100000:0.0:1788664206.112030:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664206.112044:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222180864:12345-0@lo:400: 00000100:00100000:3.0:1788664206.112062:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664206.112072:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222180992:12345-0@lo:400: 00000100:00100000:0.0:1788664206.112124:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222180864:12345-0@lo:400: Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664206.112125:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222180992:12345-0@lo:400: Request processed in 54us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664206.112140:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788664206.112189:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664206.112230:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222180864:0@lo:400: 00000100:00100000:1.0:1788664206.112271:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222181120 00000100:00100000:1.0:1788664206.112275:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222181120 00000100:00100000:1.0:1788664206.112309:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222181376 00000100:00100000:1.0:1788664206.112311:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222181376 00000100:00100000:1.0:1788664206.112327:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664206.112333:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222181120:12345-0@lo:400: 00000100:00100000:1.0:1788664206.112395:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222181120:12345-0@lo:400: Request processed in 61us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664206.112403:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664206.112417:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664206.112423:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222181376:12345-0@lo:400: 00000100:00100000:1.0:1788664206.112455:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3415c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222181376:12345-0@lo:400: Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664206.112469:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664206.112491:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222180736 00000100:00100000:1.0:1788664206.112495:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222180736 00000100:00100000:1.0:1788664206.112520:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788664206.112526:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222180736:12345-0@lo:400: 00000100:00100000:1.0:1788664206.112556:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222180736:12345-0@lo:400: Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664206.112561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788664206.112590:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664206.112592:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664206.112608:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f90fdf80 x1875550222181376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664206.112618:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788664206.112627:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222181376:0@lo:400: 00000100:00100000:2.0:1788664206.112708:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222180992:0@lo:400: 00010000:00080000:2.0:1788664206.112765:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8937100 x1875550222181120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664206.112782:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222181120:0@lo:400: 00000100:00100000:2.0:1788664206.112795:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222180736:0@lo:400: 00000100:00100000:3.0:1788664206.115010:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664206.115071:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788664206.115088:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222181248:12345-0@lo:400: 00000100:00100000:3.0:1788664206.115169:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222181248:12345-0@lo:400: Request processed in 91us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664206.115175:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788664206.115304:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222181248:0@lo:400: 00000100:00100000:1.0:1788664206.630989:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664206.631021:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222181504:0@lo:13: 00000100:00100000:1.0:1788664206.631108:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664206.631870:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222181504 00000100:00100000:0.0:1788664206.631881:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222181504 00000100:00100000:0.0:1788664206.631925:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664206.631934:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222181504:12345-0@lo:13: 00002000:00000024:0.0:1788664206.632920:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664206.633535:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222181504:12345-0@lo:13: Request processed in 1597us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664206.633545:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788664206.637051:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3415500 x1875550222181504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664206.637080:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3415500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222181504:0@lo:13: 00000001:00100000:0.0:1788664206.728253:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00010000:00010000:2.0:1788664207.135534:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664207.791335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664207.791463:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333184 00000100:00100000:3.0:1788664207.791473:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333184 00000100:00100000:3.0:1788664207.791553:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788664207.791565:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:5681:x1875550204333184:12345-192.168.202.14@tcp:41: 00000004:00000024:3.0:1788664207.791626:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788664207.791704:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:5681:x1875550204333184:12345-192.168.202.14@tcp:41: Request processed in 142us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664207.791712:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00080000:1.0:1788664207.791772:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664207.797321:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664207.797467:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333312 00000100:00100000:0.0:1788664207.797479:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333312 00000100:00100000:0.0:1788664207.797567:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788664207.797578:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e600724-38bd-4119-be7d-5264f08f0aa5+5:5681:x1875550204333312:12345-192.168.202.14@tcp:13: 00002000:00000024:0.0:1788664207.797623:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664207.797694:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e600724-38bd-4119-be7d-5264f08f0aa5+5:5681:x1875550204333312:12345-192.168.202.14@tcp:13: Request processed in 117us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664207.797714:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00080000:1.0:1788664207.797845:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664207.803004:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664207.803120:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333440 00000100:00100000:0.0:1788664207.803131:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333440 00000100:00100000:0.0:1788664207.803246:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788664207.803256:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5681:x1875550204333440:12345-192.168.202.14@tcp:13: 00002000:00000024:0.0:1788664207.803284:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664207.803376:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5e600724-38bd-4119-be7d-5264f08f0aa5+6:5681:x1875550204333440:12345-192.168.202.14@tcp:13: Request processed in 88us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664207.803384:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00080000:2.0:1788664207.803811:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788664208.159760:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664209.183724:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788664209.333015:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000100:00100000:0.0:1788664209.696326:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222181632:0@lo:13: 00000100:00100000:0.0:1788664209.696466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664209.696623:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222181632 00000100:00100000:3.0:1788664209.696635:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222181632 00000100:00100000:3.0:1788664209.696718:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788664209.696729:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222181632:12345-0@lo:13: 00002000:00000024:3.0:1788664209.696774:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664209.696825:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222181632:12345-0@lo:13: Request processed in 97us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664209.696833:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788664209.697124:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664209.697167:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612f100 x1875550222181632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664209.697189:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222181632:0@lo:13: 00000001:00100000:2.0:1788664209.737295:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00010000:00010000:3.0:1788664210.208474:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664210.384296:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664210.384413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664210.384453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664210.384477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664210.384609:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333696 00000100:00100000:3.0:1788664210.384625:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333696 00000100:00100000:3.0:1788664210.384757:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:3.0:1788664210.384771:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204333696:12345-192.168.202.14@tcp:400: 00000100:00100000:3.0:1788664210.384885:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204333696:12345-192.168.202.14@tcp:400: Request processed in 116us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664210.384894:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:3.0:1788664210.384922:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333568 00000100:00100000:3.0:1788664210.384926:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333568 00000100:00100000:3.0:1788664210.384951:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00100000:3.0:1788664210.384958:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2361:x1875550204333568:12345-192.168.202.14@tcp:400: 00000100:00100000:3.0:1788664210.384987:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2361:x1875550204333568:12345-192.168.202.14@tcp:400: Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664210.385001:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00080000:2.0:1788664210.385203:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664210.385473:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333952 00000100:00100000:1.0:1788664210.385480:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333952 00000100:00100000:1.0:1788664210.385536:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204333824 00000100:00100000:1.0:1788664210.385540:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204333824 00000100:00100000:1.0:1788664210.385560:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788664210.385569:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204333952:12345-192.168.202.14@tcp:400: 00000100:00100000:1.0:1788664210.385619:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204333952:12345-192.168.202.14@tcp:400: Request processed in 51us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664210.385636:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788664210.385653:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788664210.385660:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204333824:12345-192.168.202.14@tcp:400: 00000100:00100000:1.0:1788664210.385689:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204333824:12345-192.168.202.14@tcp:400: Request processed in 29us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664210.385695:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00080000:0.0:1788664210.386136:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664210.386142:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1788664211.191933:0:8313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788664211.234660:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222181760:0@lo:400: 00000100:00100000:1.0:1788664211.234762:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664211.234819:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222182272:0@lo:400: 00000100:00100000:1.0:1788664211.236082:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664211.236137:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664211.236147:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222182144:0@lo:400: 00000100:00100000:1.0:1788664211.236180:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664211.236221:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222181888:0@lo:400: 00000100:00100000:1.0:1788664211.236244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664211.236261:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222182400:0@lo:400: 00000100:00100000:0.0:1788664211.238873:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222182272 00000100:00100000:0.0:1788664211.238897:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222182272 00000100:00100000:0.0:1788664211.238994:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222181888 00000100:00100000:0.0:1788664211.238997:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222181888 00000100:00100000:0.0:1788664211.239031:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664211.239044:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222182272:12345-0@lo:400: 00000100:00100000:0.0:1788664211.239193:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222182272:12345-0@lo:400: Request processed in 152us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664211.239202:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664211.239224:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664211.239231:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222181888:12345-0@lo:400: 00000100:00100000:0.0:1788664211.239265:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222181888:12345-0@lo:400: Request processed in 35us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664211.239271:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664211.239293:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222181760 00000100:00100000:0.0:1788664211.239297:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222181760 00000100:00100000:0.0:1788664211.239338:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788664211.239366:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222181760:12345-0@lo:400: 00000100:00100000:0.0:1788664211.239399:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222181760:12345-0@lo:400: Request processed in 35us (4638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664211.239405:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788664211.239450:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222182016:0@lo:400: 00000100:00100000:0.0:1788664211.239510:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788664211.239556:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664211.239566:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222182016 00000100:00100000:0.0:1788664211.239570:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222182016 00000100:00100000:0.0:1788664211.239593:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664211.239598:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222182016:12345-0@lo:400: 00000100:00100000:0.0:1788664211.239629:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3415500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222182016:12345-0@lo:400: Request processed in 31us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664211.239635:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788664211.239653:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664211.239693:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222182016:0@lo:400: 00000100:00100000:0.0:1788664211.240599:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222182144 00000100:00100000:0.0:1788664211.240610:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222182144 00000100:00100000:0.0:1788664211.240666:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664211.240674:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222182144:12345-0@lo:400: 00000100:00100000:0.0:1788664211.240732:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222182144:12345-0@lo:400: Request processed in 59us (4551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664211.240738:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788664211.240754:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664211.244804:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f80df800 x1875550222182144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664211.244830:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222182144:0@lo:400: 00000100:00100000:1.0:1788664211.244844:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222181760:0@lo:400: 00000100:00100000:1.0:1788664211.244857:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222182272:0@lo:400: 00000100:00100000:1.0:1788664211.244967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664211.245044:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222182400 00000100:00100000:1.0:1788664211.245052:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222182400 00000100:00100000:1.0:1788664211.245126:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664211.245137:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222182400:12345-0@lo:400: 00000100:00100000:1.0:1788664211.245203:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222182400:12345-0@lo:400: Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664211.245211:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788664211.245237:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788664211.245264:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f80dfb80 x1875550222182400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664211.245275:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222182400:0@lo:400: 00000100:00100000:1.0:1788664211.245301:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222181888:0@lo:400: 00010000:00010000:2.0:1788664211.245738:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664211.745560:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222182528:0@lo:13: 00000100:00100000:2.0:1788664211.745650:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664211.746034:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222182528 00000100:00100000:3.0:1788664211.746051:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222182528 00000100:00100000:3.0:1788664211.746139:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664211.746153:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222182528:12345-0@lo:13: 00002000:00000024:3.0:1788664211.746216:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664211.746628:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222182528:12345-0@lo:13: Request processed in 477us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664211.746639:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788664211.746749:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3414e00 x1875550222182528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664211.746850:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3414e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222182528:0@lo:13: 00010000:00010000:0.0:1788664212.256285:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664213.281263:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664214.314140:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664214.819398:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222182656:0@lo:13: 00000100:00100000:1.0:1788664214.819484:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664214.819654:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222182656 00000100:00100000:3.0:1788664214.819663:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222182656 00000100:00100000:3.0:1788664214.819730:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664214.819740:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222182656:12345-0@lo:13: 00002000:00000024:3.0:1788664214.819780:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664214.819841:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222182656:12345-0@lo:13: Request processed in 103us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664214.819848:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788664214.819897:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612c380 x1875550222182656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664214.819919:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222182656:0@lo:13: 00000100:00080000:1.0:1788664214.819995:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664215.334638:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664215.482852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664215.482915:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664215.482992:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334208 00000100:00100000:3.0:1788664215.483002:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334208 00000100:00100000:1.0:1788664215.483094:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334080 00000100:00100000:1.0:1788664215.483099:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334080 00000100:00100000:1.0:1788664215.483137:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:1.0:1788664215.483147:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204334080:12345-192.168.202.14@tcp:400: 00000100:00100000:1.0:1788664215.483221:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204334080:12345-192.168.202.14@tcp:400: Request processed in 75us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664215.483229:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00080000:2.0:1788664215.483645:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664215.484988:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:3.0:1788664215.485005:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204334208:12345-192.168.202.14@tcp:400: 00000100:00100000:3.0:1788664215.485123:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204334208:12345-192.168.202.14@tcp:400: Request processed in 122us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664215.485141:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:2.0:1788664215.498070:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664215.498109:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664215.498141:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334464 00000100:00100000:2.0:1788664215.498151:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334464 00000100:00100000:2.0:1788664215.498213:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334336 00000100:00100000:2.0:1788664215.498216:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334336 00000100:00100000:2.0:1788664215.498236:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788664215.498245:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204334464:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788664215.498369:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204334464:12345-192.168.202.14@tcp:400: Request processed in 124us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664215.498377:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788664215.498392:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788664215.498398:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204334336:12345-192.168.202.14@tcp:400: 00000100:00100000:2.0:1788664215.498419:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204334336:12345-192.168.202.14@tcp:400: Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664215.498425:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00080000:2.0:1788664215.498456:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664215.498460:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1788664215.611902:0:8460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff16e9df0 20000000:00000080:2.0:1788664215.611922:0:8460:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b68fb4e2000 uarg=0000000000000000 20000000:01000000:2.0:1788664215.611963:0:8460:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788664215.611966:0:8460:0:(mgs_llog.c:6068:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788664215.611968:0:8460:0:(mgs_llog.c:6099:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788664215.611974:0:8460:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788664215.611979:0:8460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788664215.611995:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788664215.611998:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788664215.612232:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788664215.612240:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788664215.615002:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788664215.616206:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788664215.616692:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788664215.616738:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788664215.616755:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788664215.616758:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788664215.623062:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788664215.623726:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788664215.623782:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788664215.623821:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788664215.623835:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788664215.623838:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788664215.628988:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788664215.633094:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788664215.633150:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788664215.633208:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788664215.633229:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788664215.633232:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788664215.642310:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788664215.645838:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788664215.645920:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788664215.645957:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1788664215.645977:0:8460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788664215.645996:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646013:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90054 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646020:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9007e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646026:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900a8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646032:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900b6 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646037:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900c4 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646043:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be900e0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646061:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9010a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646072:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646079:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646087:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646128:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646143:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 9 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.646156:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222182784:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664215.646262:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646271:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 9 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.646279:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222182912:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664215.646312:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9010a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646331:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9010a expref: 18 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.646364:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183040:0@lo:104: 00000100:00100000:3.0:1788664215.646420:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664215.646460:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183040 00010000:00010000:3.0:1788664215.646464:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be900e0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664215.646469:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183040 00010000:00010000:3.0:1788664215.646476:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be900e0 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.646486:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183168:0@lo:104: 00000100:00100000:3.0:1788664215.646513:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664215.646799:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be900c4 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646807:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be900c4 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.646816:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183296:0@lo:104: 00010000:00010000:3.0:1788664215.646842:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be900b6 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.646850:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be900b6 expref: 18 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.646958:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183424:0@lo:104: 00010000:00010000:3.0:1788664215.646987:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be900a8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.647003:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be900a8 expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.647011:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183552:0@lo:104: 00010000:00010000:3.0:1788664215.647076:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9007e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.647084:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9007e expref: 18 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.647092:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183680:0@lo:104: 00010000:00010000:3.0:1788664215.647115:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be90054 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.647123:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be90054 expref: 18 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.647131:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183808:0@lo:104: 00000100:00100000:3.0:1788664215.647148:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664215.648987:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788664215.649030:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664215.649057:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664215.649070:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664215.649081:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664215.649091:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664215.649100:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183168 00000100:00100000:0.0:1788664215.649108:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183168 00000100:00100000:0.0:1788664215.649152:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183296 00000100:00100000:0.0:1788664215.649155:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183296 00000100:00100000:0.0:1788664215.649164:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183424 00000100:00100000:0.0:1788664215.649166:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183424 00000100:00100000:0.0:1788664215.649174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183552 00000100:00100000:0.0:1788664215.649176:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183552 00000100:00100000:0.0:1788664215.649185:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183680 00000100:00100000:0.0:1788664215.649200:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183680 00000100:00100000:0.0:1788664215.649214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183808 00000100:00100000:0.0:1788664215.649216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183808 00000100:00100000:0.0:1788664215.649231:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664215.649241:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:8460:x1875550222183040:12345-0@lo:104: 00010000:00010000:0.0:1788664215.649259:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.649367:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664215.649374:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+9:8460:x1875550222183040:12345-0@lo:104: Request processed in 135us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664215.649382:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664215.649416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664215.649423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+8:8460:x1875550222183168:12345-0@lo:104: 00010000:00010000:0.0:1788664215.649431:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.649470:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788664215.649475:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+8:8460:x1875550222183168:12345-0@lo:104: Request processed in 53us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664215.649481:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664215.649522:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664215.649528:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+7:8460:x1875550222183296:12345-0@lo:104: 00010000:00010000:0.0:1788664215.649547:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649706:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664215.649713:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649732:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664215.649736:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649744:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664215.649751:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664215.649756:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664215.649797:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649803:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664215.649825:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649833:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9010a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90111 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649853:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664215.649857:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649862:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215b200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664215.649864:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649882:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664215.649888:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664215.649893:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788664215.649925:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649932:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664215.649954:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649961:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215b200/0x762f55027be900e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900e7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.649972:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664215.649975:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664215.649977:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664215.650002:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222183936:0@lo:103: 00000100:00100000:1.0:1788664215.650107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664215.650157:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222184064:0@lo:103: 00000100:00100000:1.0:1788664215.650178:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664215.650207:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222183936 00000100:00100000:1.0:1788664215.650212:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222183936 00010000:00010000:1.0:1788664215.650237:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9010a expref: 19 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664215.650275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184064 00000100:00100000:1.0:1788664215.650279:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184064 00010000:00010000:1.0:1788664215.650292:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900e0 expref: 20 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664215.650311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664215.650317:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+20:3308:x1875550222183936:12345-0@lo:103: 00010000:00010000:1.0:1788664215.650329:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664215.650334:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9010a expref: 20 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.650366:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9010a expref: 20 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.650396:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664215.650426:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+20:3308:x1875550222183936:12345-0@lo:103: Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664215.650434:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664215.650449:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664215.650455:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222184064:12345-0@lo:103: 00010000:00010000:1.0:1788664215.650464:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664215.650468:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900e0 expref: 19 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.650477:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be900e0 expref: 19 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.650487:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664215.650523:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222184064:12345-0@lo:103: Request processed in 69us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664215.650530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664215.650697:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222184064:0@lo:103: 00000100:00100000:1.0:1788664215.650725:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222183936:0@lo:103: 00010000:00010000:0.0:1788664215.650824:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664215.650831:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+7:8460:x1875550222183296:12345-0@lo:104: Request processed in 1304us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664215.650844:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664215.650860:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664215.650866:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:8460:x1875550222183424:12345-0@lo:104: 00010000:00010000:0.0:1788664215.650873:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.650902:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788664215.650906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+6:8460:x1875550222183424:12345-0@lo:104: Request processed in 42us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664215.650910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664215.650920:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788664215.650925:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:8460:x1875550222183552:12345-0@lo:104: 00010000:00010000:0.0:1788664215.650933:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.650956:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788664215.650960:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:8460:x1875550222183552:12345-0@lo:104: Request processed in 35us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664215.650965:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788664215.650976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788664215.650981:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:8460:x1875550222183680:12345-0@lo:104: 00010000:00010000:0.0:1788664215.650987:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651009:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788664215.651012:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:8460:x1875550222183680:12345-0@lo:104: Request processed in 32us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664215.651022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788664215.651033:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788664215.651039:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:8460:x1875550222183808:12345-0@lo:104: 00010000:00010000:0.0:1788664215.651047:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651072:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788664215.651075:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:8460:x1875550222183808:12345-0@lo:104: Request processed in 39us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664215.651080:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788664215.651097:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788664215.651101:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651108:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215a400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664215.651111:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651118:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664215.651124:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664215.651128:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664215.651149:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651154:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664215.651169:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651176:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215a400/0x762f55027be900c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900cb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651189:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788664215.651192:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651198:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664215.651201:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651207:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664215.651212:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664215.651216:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664215.651231:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651236:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664215.651243:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651249:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1478600/0x762f55027be900b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900bd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651257:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788664215.651266:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651272:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664215.651275:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651282:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664215.651287:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664215.651291:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664215.651306:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651312:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664215.651318:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651324:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be900a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be900af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651334:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664215.651336:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651366:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215a600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664215.651369:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651385:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664215.651402:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664215.651408:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664215.651423:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651429:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664215.651435:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651443:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215a600/0x762f55027be9007e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90085 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651453:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664215.651456:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651461:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664215.651463:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651469:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664215.651475:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664215.651488:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664215.651503:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651511:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664215.651516:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.651524:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c147a200/0x762f55027be90054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be9005b expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.651532:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479400/0x762f55027be90111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9010a expref: 18 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.651548:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183040:0@lo:104: 00010000:00010000:3.0:1788664215.651559:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ef600/0x762f55027be900e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be900e0 expref: 17 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.651567:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183168:0@lo:104: 00000100:00100000:3.0:1788664215.651574:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183296:0@lo:104: 00000100:00100000:3.0:1788664215.651591:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183424:0@lo:104: 00000100:00100000:3.0:1788664215.651598:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183552:0@lo:104: 00000100:00100000:3.0:1788664215.651604:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183680:0@lo:104: 00000100:00100000:3.0:1788664215.651610:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222183808:0@lo:104: 00000100:00100000:2.0:1788664215.651961:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1788664215.651986:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222184192:0@lo:103: 00000100:00100000:2.0:1788664215.652029:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664215.652063:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222184704:0@lo:103: 00000100:00100000:2.0:1788664215.652085:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664215.652101:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664215.652106:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222184576:0@lo:103: 00000100:00100000:2.0:1788664215.652128:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664215.652152:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184192 00000100:00100000:2.0:1788664215.652157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184192 00010000:00010000:2.0:1788664215.652181:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900c4 expref: 17 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664215.652199:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184704 00000100:00100000:2.0:1788664215.652201:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184704 00010000:00010000:2.0:1788664215.652211:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be90054 expref: 18 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664215.652219:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184576 00000100:00100000:2.0:1788664215.652221:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184576 00010000:00010000:2.0:1788664215.652241:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9007e expref: 19 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664215.652253:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788664215.652259:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222184192:12345-0@lo:103: 00010000:00010000:2.0:1788664215.652270:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664215.652275:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900c4 expref: 19 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652294:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be900c4 expref: 19 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652309:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215b800/0x762f55027be900cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be900c4 expref: 19 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652320:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664215.652365:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:3310:x1875550222184192:12345-0@lo:103: Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664215.652371:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788664215.652387:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664215.652403:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:3310:x1875550222184704:12345-0@lo:103: 00010000:00010000:2.0:1788664215.652411:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664215.652416:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be90054 expref: 17 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652423:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be90054 expref: 17 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652433:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ef800/0x762f55027be9005b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be90054 expref: 17 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652452:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664215.652475:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3310:x1875550222184704:12345-0@lo:103: Request processed in 73us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664215.652481:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664215.652492:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788664215.652498:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3310:x1875550222184576:12345-0@lo:103: 00010000:00010000:2.0:1788664215.652506:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664215.652510:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9007e expref: 15 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652518:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9007e expref: 15 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652527:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b200/0x762f55027be90085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9007e expref: 15 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664215.652536:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664215.652687:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:3310:x1875550222184576:12345-0@lo:103: Request processed in 188us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664215.652693:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788664215.652723:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222184576:0@lo:103: 00000100:00100000:2.0:1788664215.652730:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222184192:0@lo:103: 00000100:00100000:2.0:1788664215.652736:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222184704:0@lo:103: 00010000:00010000:0.0:1788664215.652995:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664215.652998:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664215.653000:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664215.653147:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664215.653162:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222184320:0@lo:103: 00000100:00100000:1.0:1788664215.653199:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664215.653235:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664215.653242:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222184448:0@lo:103: 00000100:00100000:1.0:1788664215.653266:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664215.653301:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184320 00000100:00100000:1.0:1788664215.653306:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184320 00010000:00010000:1.0:1788664215.653328:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900b6 expref: 14 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664215.653366:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184448 00000100:00100000:1.0:1788664215.653369:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184448 00010000:00010000:1.0:1788664215.653382:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900a8 expref: 15 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664215.653405:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664215.653412:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3307:x1875550222184320:12345-0@lo:103: 00010000:00010000:1.0:1788664215.653421:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664215.653426:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900b6 expref: 15 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.653435:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be900b6 expref: 15 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.653455:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215ac00/0x762f55027be900bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be900b6 expref: 15 pid: 5849 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.653465:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664215.653496:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:3307:x1875550222184320:12345-0@lo:103: Request processed in 84us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664215.653501:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788664215.653515:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664215.653522:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5893050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:3307:x1875550222184448:12345-0@lo:103: 00010000:00010000:1.0:1788664215.653529:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664215.653532:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be900a8 expref: 13 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.653551:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be900a8 expref: 13 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.653569:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215ba00/0x762f55027be900af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be900a8 expref: 13 pid: 5848 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.653576:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664215.653598:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5893050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3307:x1875550222184448:12345-0@lo:103: Request processed in 77us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664215.653603:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788664215.653677:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222184448:0@lo:103: 00000100:00100000:1.0:1788664215.653685:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222184320:0@lo:103: 00010000:00010000:1.0:1788664215.653704:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664215.654251:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222182784:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664215.654260:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1875550222182912:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664215.654309:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664215.656781:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664215.656868:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334592 00000100:00100000:1.0:1788664215.656887:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334592 00010000:00010000:1.0:1788664215.656922:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 10 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664215.656954:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788664215.656962:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204334592:12345-192.168.202.14@tcp:103: 00010000:00010000:1.0:1788664215.656976:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664215.656981:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 10 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.656993:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 10 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.657009:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479000/0x762f55027be90126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243608 expref: 10 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664215.657028:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664215.657084:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:2360:x1875550204334592:12345-192.168.202.14@tcp:103: Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664215.657091:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788664215.659855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664215.660151:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334720 00000100:00100000:3.0:1788664215.660163:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334720 00010000:00010000:3.0:1788664215.660205:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 9 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664215.660247:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:3.0:1788664215.660258:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:2360:x1875550204334720:12345-192.168.202.14@tcp:103: 00010000:00010000:3.0:1788664215.660273:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664215.660279:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 9 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660302:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 9 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660322:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b400/0x762f55027be9011f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243601 expref: 9 pid: 5848 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660367:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660390:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660418:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660426:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660434:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660441:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660447:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147be00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664215.660452:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.660459:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.660960:0:8460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664215.660971:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.664623:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.664643:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147be00/0x762f55027be9015e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664215.664670:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664215.664755:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:2360:x1875550204334720:12345-192.168.202.14@tcp:103: Request processed in 4494us (4904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664215.664777:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788664216.351740:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222185216:0@lo:400: 00010000:00010000:0.0:1788664216.351775:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664216.351827:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664216.351859:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222184960:0@lo:400: 00000100:00100000:2.0:1788664216.351909:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664216.351915:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664216.351920:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222185088:0@lo:400: 00000100:00100000:3.0:1788664216.351939:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222185472:0@lo:400: 00000100:00100000:2.0:1788664216.351962:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664216.352018:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664216.352157:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222184832:0@lo:400: 00000100:00100000:1.0:1788664216.352185:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664216.352204:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222185344:0@lo:400: 00000100:00100000:1.0:1788664216.352219:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664216.352245:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184832 00000100:00100000:1.0:1788664216.352252:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184832 00000100:00100000:1.0:1788664216.352295:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788664216.352305:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3307:x1875550222184832:12345-0@lo:400: 00000100:00100000:1.0:1788664216.352375:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:3307:x1875550222184832:12345-0@lo:400: Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664216.352384:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788664216.352436:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222184832:0@lo:400: 00000100:00100000:1.0:1788664216.352480:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222184960 00000100:00100000:1.0:1788664216.352483:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222184960 00000100:00100000:1.0:1788664216.352504:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185088 00000100:00100000:1.0:1788664216.352506:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185088 00000100:00100000:1.0:1788664216.352519:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185344 00000100:00100000:1.0:1788664216.352520:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185344 00000100:00100000:1.0:1788664216.352529:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788664216.352533:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222184960:12345-0@lo:400: 00000100:00100000:1.0:1788664216.352566:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222184960:12345-0@lo:400: Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664216.352572:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788664216.352584:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788664216.352590:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222185088:12345-0@lo:400: 00000100:00100000:1.0:1788664216.352619:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222185088:12345-0@lo:400: Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664216.352625:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788664216.352636:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664216.352640:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222185344:12345-0@lo:400: 00000100:00100000:1.0:1788664216.352663:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222185344:12345-0@lo:400: Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664216.352669:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788664216.352699:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222185344:0@lo:400: 00000100:00100000:3.0:1788664216.352981:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222184960:0@lo:400: 00000100:00100000:0.0:1788664216.353008:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185216 00000100:00100000:0.0:1788664216.353013:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185216 00000100:00100000:0.0:1788664216.353252:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185472 00000100:00100000:0.0:1788664216.353257:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185472 00000100:00100000:0.0:1788664216.353276:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664216.353283:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222185216:12345-0@lo:400: 00000100:00100000:2.0:1788664216.353284:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788664216.353292:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788664216.353315:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664216.353319:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664216.353321:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664216.353323:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222185216:12345-0@lo:400: Request processed in 40us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664216.353354:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664216.353356:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222185088:0@lo:400: 00000100:00100000:0.0:1788664216.353369:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788664216.353375:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222185472:12345-0@lo:400: 00010000:00080000:2.0:1788664216.353382:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3417b80 x1875550222185216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664216.353392:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222185216:0@lo:400: 00000100:00100000:0.0:1788664216.353406:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222185472:12345-0@lo:400: Request processed in 32us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664216.353412:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788664216.353560:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e07100 x1875550222185472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664216.353568:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222185472:0@lo:400: 00000100:00100000:1.0:1788664216.863773:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222185600:0@lo:13: 00000100:00100000:1.0:1788664216.863848:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664216.864043:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185600 00000100:00100000:0.0:1788664216.864052:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185600 00000100:00100000:0.0:1788664216.864106:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664216.864117:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222185600:12345-0@lo:13: 00002000:00000024:0.0:1788664216.864158:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664216.864206:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222185600:12345-0@lo:13: Request processed in 91us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664216.864214:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788664216.864642:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e04380 x1875550222185600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664216.864663:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222185600:0@lo:13: 00010000:00010000:1.0:1788664217.377125:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788664217.377303:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788664217.377308:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68c343c800 from 39 10000000:01000000:2.0:1788664217.377314:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664217.377377:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.377389:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.377400:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664217.377426:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222185728:0@lo:101: 00000100:00100000:2.0:1788664217.377496:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664217.377562:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e65f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.377846:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185728 00000100:00100000:1.0:1788664217.377855:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185728 00000100:00100000:1.0:1788664217.377912:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788664217.377922:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+12:5852:x1875550222185728:12345-0@lo:101: 00010000:00010000:1.0:1788664217.377937:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664217.377951:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1479000/0x762f55027be9016c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be90165 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.377974:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479000/0x762f55027be9016c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be90165 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.377986:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1479000/0x762f55027be9016c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90165 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.377996:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479000, rc 0) 00000100:00100000:1.0:1788664217.378045:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222185728:12345-0@lo:101: Request processed in 124us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.378052:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788664217.378198:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222185728:0@lo:101: 00010000:00010000:2.0:1788664217.378225:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.378234:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664217.378295:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222185856:0@lo:501: 00000100:00100000:2.0:1788664217.378322:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664217.378375:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e65f8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664217.378497:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185856 00000100:00100000:0.0:1788664217.378503:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185856 00000100:00100000:0.0:1788664217.378554:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788664217.378562:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222185856:12345-0@lo:501: 00000100:00100000:3.0:1788664217.379106:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222185856:0@lo:501: 00000100:00100000:3.0:1788664217.379140:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222185984:0@lo:503: 00000100:00100000:3.0:1788664217.379184:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.379195:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664217.379235:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222185856:12345-0@lo:501: Request processed in 281us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664217.379243:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788664217.379265:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222185984 00000100:00100000:0.0:1788664217.379269:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222185984 00000100:00100000:0.0:1788664217.379284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788664217.379290:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222185984:12345-0@lo:503: 00000100:00100000:0.0:1788664217.379474:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222185984:12345-0@lo:503: Request processed in 182us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664217.379488:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788664217.379581:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222185984:0@lo:503: 00000100:00100000:3.0:1788664217.380387:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8477:1875550222186112:0@lo:502: 00000100:00100000:3.0:1788664217.380434:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.380471:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664217.380524:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222186112 00000100:00100000:0.0:1788664217.380529:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222186112 00000100:00100000:0.0:1788664217.380770:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788664217.380778:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:8477:x1875550222186112:12345-0@lo:502: 00000100:00100000:0.0:1788664217.381257:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:8477:x1875550222186112:12345-0@lo:502: Request processed in 479us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664217.381265:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788664217.381382:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8477:1875550222186112:0@lo:502: 00000100:00100000:3.0:1788664217.381428:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8477:1875550222186240:0@lo:502: 00000100:00100000:3.0:1788664217.381468:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.381500:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.381573:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222186240 00000100:00100000:1.0:1788664217.381579:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222186240 00000100:00100000:1.0:1788664217.381626:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788664217.381634:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:8477:x1875550222186240:12345-0@lo:502: 00000100:00100000:1.0:1788664217.381805:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:8477:x1875550222186240:12345-0@lo:502: Request processed in 171us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.381820:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788664217.382220:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8477:1875550222186240:0@lo:502: 00000040:00080000:3.0:1788664217.382245:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788664217.388201:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788664217.388241:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664217.388253:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.388264:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664217.388274:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788664217.388277:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788664217.388280:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788664217.388320:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.388328:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.388360:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664217.388386:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222186368:0@lo:101: 00000100:00100000:2.0:1788664217.388471:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664217.388506:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e65f8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664217.388618:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222186368 00000100:00100000:0.0:1788664217.388627:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222186368 00000100:00100000:0.0:1788664217.388678:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788664217.388687:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+13:5852:x1875550222186368:12345-0@lo:101: 00010000:00010000:0.0:1788664217.388701:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664217.388713:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66eea00/0x762f55027be9017a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be90173 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.388736:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66eea00/0x762f55027be9017a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be90173 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.388747:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66eea00/0x762f55027be9017a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90173 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.388766:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66eea00, rc 0) 00000100:00100000:0.0:1788664217.388814:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222186368:12345-0@lo:101: Request processed in 127us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664217.388830:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788664217.389099:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222186368:0@lo:101: 00010000:00010000:3.0:1788664217.389115:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664217.389125:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664217.389178:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222186496:0@lo:501: 00000100:00100000:3.0:1788664217.389210:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.389241:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.389299:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222186496 00000100:00100000:1.0:1788664217.389304:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222186496 00000100:00100000:1.0:1788664217.389367:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788664217.389377:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222186496:12345-0@lo:501: 00000100:00100000:1.0:1788664217.389653:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222186496:12345-0@lo:501: Request processed in 277us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.389660:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788664217.389744:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222186496:0@lo:501: 00000100:00100000:3.0:1788664217.389786:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222186624:0@lo:503: 00000100:00100000:3.0:1788664217.389836:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.389865:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.390089:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222186624 00000100:00100000:1.0:1788664217.390095:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222186624 00000100:00100000:1.0:1788664217.390118:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788664217.390124:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222186624:12345-0@lo:503: 00000100:00100000:1.0:1788664217.390292:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222186624:12345-0@lo:503: Request processed in 167us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.390298:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788664217.392507:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222186624:0@lo:503: 00000100:00100000:3.0:1788664217.396824:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8478:1875550222186752:0@lo:502: 00000100:00100000:3.0:1788664217.396932:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.396974:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.397171:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222186752 00000100:00100000:1.0:1788664217.397179:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222186752 00000100:00100000:1.0:1788664217.397224:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788664217.397232:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:8478:x1875550222186752:12345-0@lo:502: 00000100:00100000:1.0:1788664217.397462:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:8478:x1875550222186752:12345-0@lo:502: Request processed in 230us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.397470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788664217.397594:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8478:1875550222186752:0@lo:502: 00000020:01000000:3.0:1788664217.397634:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664217.397644:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664217.397646:0:8478:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788664217.397651:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788664217.397673:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8478:1875550222186880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664217.397714:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.397733:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.398321:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222186880 00000100:00100000:1.0:1788664217.398329:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222186880 00000100:00100000:1.0:1788664217.398394:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788664217.398410:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:8478:x1875550222186880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664217.398588:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:8478:x1875550222186880:12345-0@lo:502:llog_process_th.0 Request processed in 178us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.398596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788664217.398894:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8478:1875550222186880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664217.398922:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664217.398929:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664217.398931:0:8478:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788664217.398935:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788664217.399168:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788664217.399188:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788664217.399198:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.399209:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664217.399219:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788664217.399222:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68f8b62000 from 39 10000000:01000000:2.0:1788664217.399225:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664217.399254:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.399262:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.399284:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664217.399305:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.399371:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664217.399397:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e65f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.399528:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187008 00000100:00100000:1.0:1788664217.399533:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187008 00000100:00100000:1.0:1788664217.399586:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788664217.399594:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:5852:x1875550222187008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664217.399604:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664217.399629:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1479c00/0x762f55027be90188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be90181 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.399650:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479c00/0x762f55027be90188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be90181 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.399660:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1479c00/0x762f55027be90188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90181 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.399668:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479c00, rc 0) 00000100:00100000:1.0:1788664217.399706:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222187008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.399712:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788664217.400526:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664217.400962:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664217.400974:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664217.401048:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664217.401098:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.401128:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.401449:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187136 00000100:00100000:1.0:1788664217.401456:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187136 00000100:00100000:1.0:1788664217.401496:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788664217.401505:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222187136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.404146:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222187136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2633us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.404170:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788664217.404494:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664217.404563:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664217.404631:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.404665:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.404775:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187264 00000100:00100000:2.0:1788664217.404782:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187264 00000100:00100000:2.0:1788664217.404840:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788664217.404849:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222187264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.405210:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222187264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 361us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.405217:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788664217.406683:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664217.407625:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8479:1875550222187392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664217.407707:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.407747:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.408050:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187392 00000100:00100000:1.0:1788664217.408057:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187392 00000100:00100000:1.0:1788664217.408107:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788664217.408117:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:8479:x1875550222187392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664217.408416:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:8479:x1875550222187392:12345-0@lo:502:llog_process_th.0 Request processed in 299us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.408424:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788664217.408681:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8479:1875550222187392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664217.408730:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8479:1875550222187520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664217.408781:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664217.408810:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.409147:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187520 00000100:00100000:1.0:1788664217.409152:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187520 00000100:00100000:1.0:1788664217.409194:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788664217.409201:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:8479:x1875550222187520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664217.409376:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:8479:x1875550222187520:12345-0@lo:502:llog_process_th.0 Request processed in 175us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.409383:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788664217.409463:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8479:1875550222187520:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788664217.409488:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788664217.409789:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788664217.409809:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788664217.409819:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.409831:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664217.409848:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788664217.409851:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788664217.409854:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788664217.410040:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.410058:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.410069:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664217.410087:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.410124:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.410160:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c5b0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.410223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187648 00000100:00100000:2.0:1788664217.410228:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187648 00000100:00100000:2.0:1788664217.410270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788664217.410278:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:5852:x1875550222187648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664217.410288:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664217.410301:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512bc00/0x762f55027be90196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9018f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.410324:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512bc00/0x762f55027be90196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9018f expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.410336:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512bc00/0x762f55027be90196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9018f expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.410375:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512bc00, rc 0) 00000100:00100000:2.0:1788664217.410419:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222187648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.410426:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788664217.411406:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664217.411428:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.411440:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664217.411516:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.411742:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.411780:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c5b0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.412135:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187776 00000100:00100000:2.0:1788664217.412142:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187776 00000100:00100000:2.0:1788664217.412176:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788664217.412185:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222187776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.412496:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222187776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.412513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788664217.414563:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.414635:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.414709:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.414749:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c5b0f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.414999:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222187904 00000100:00100000:2.0:1788664217.415006:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222187904 00000100:00100000:2.0:1788664217.415054:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788664217.415062:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222187904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.415250:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222187904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.415258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788664217.415375:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222187904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.416090:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8480:1875550222188032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664217.416132:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664217.416163:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c91dc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.416208:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188032 00000100:00100000:1.0:1788664217.416218:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188032 00000100:00100000:1.0:1788664217.416250:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788664217.416257:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:8480:x1875550222188032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664217.416455:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:8480:x1875550222188032:12345-0@lo:502:llog_process_th.0 Request processed in 197us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.416463:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788664217.416767:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8480:1875550222188032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664217.416800:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664217.416809:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664217.416811:0:8480:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788664217.416816:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788664217.416848:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8480:1875550222188160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664217.416888:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664217.416911:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.417108:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188160 00000100:00100000:1.0:1788664217.417113:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188160 00000100:00100000:1.0:1788664217.417146:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788664217.417152:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:8480:x1875550222188160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664217.417296:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:8480:x1875550222188160:12345-0@lo:502:llog_process_th.0 Request processed in 142us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.417305:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788664217.417553:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8480:1875550222188160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664217.417574:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664217.417580:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664217.417582:0:8480:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788664217.417585:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788664217.417794:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788664217.417814:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788664217.417824:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.417835:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664217.417856:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788664217.417860:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68d438d000 from 39 10000000:01000000:1.0:1788664217.417863:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788664217.417896:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.417904:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.417921:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664217.417936:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.417970:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.417999:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.418264:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188288 00000100:00100000:2.0:1788664217.418269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188288 00000100:00100000:2.0:1788664217.418316:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788664217.418323:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222188288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664217.418334:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664217.418374:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512b600/0x762f55027be901a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9019d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.418399:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512b600/0x762f55027be901a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9019d expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.418410:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512b600/0x762f55027be901a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9019d expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.418419:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b600, rc 0) 00000100:00100000:2.0:1788664217.418464:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222188288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.418470:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788664217.419142:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664217.419159:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.419169:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664217.419227:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.419263:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.419299:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664217.419505:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188416 00000100:00100000:0.0:1788664217.419511:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188416 00000100:00100000:0.0:1788664217.419560:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788664217.419569:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222188416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664217.419849:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222188416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664217.419857:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788664217.420189:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.420223:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.420263:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.420286:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.420675:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188544 00000100:00100000:2.0:1788664217.420681:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188544 00000100:00100000:2.0:1788664217.420720:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788664217.420727:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222188544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.420922:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222188544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.420929:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788664217.421383:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664217.422118:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8481:1875550222188672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664217.422168:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664217.422203:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c60159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.422241:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188672 00000100:00100000:2.0:1788664217.422247:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188672 00000100:00100000:2.0:1788664217.422283:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788664217.422290:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8481:x1875550222188672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664217.422503:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8481:x1875550222188672:12345-0@lo:502:llog_process_th.0 Request processed in 213us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.422516:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788664217.422770:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8481:1875550222188672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664217.422820:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8481:1875550222188800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664217.422862:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664217.422984:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c60159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664217.427238:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188800 00000100:00100000:1.0:1788664217.427253:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188800 00000100:00100000:1.0:1788664217.427324:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788664217.427335:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8481:x1875550222188800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664217.427727:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8481:x1875550222188800:12345-0@lo:502:llog_process_th.0 Request processed in 394us (4863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664217.427736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788664217.428065:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8481:1875550222188800:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788664217.428105:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788664217.428397:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788664217.428421:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664217.428433:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.428446:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664217.428457:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788664217.428460:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788664217.428464:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664217.428513:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.428521:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.428531:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664217.428561:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.428608:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664217.428653:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664217.428837:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222188928 00000100:00100000:3.0:1788664217.428845:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222188928 00000100:00100000:3.0:1788664217.429046:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788664217.429056:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222188928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664217.429069:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664217.429085:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147be00/0x762f55027be901b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be901ab expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664217.429111:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147be00/0x762f55027be901b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be901ab expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664217.429123:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147be00/0x762f55027be901b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901ab expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664217.429132:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147be00, rc 0) 00000100:00100000:3.0:1788664217.429187:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222188928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664217.429194:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788664217.429617:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222188928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664217.429644:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664217.429654:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664217.429715:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.429747:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.429772:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664217.429987:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222189056 00000100:00100000:0.0:1788664217.429993:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222189056 00000100:00100000:0.0:1788664217.430031:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788664217.430038:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222189056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664217.430315:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222189056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664217.430322:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788664217.431624:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.431694:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664217.431765:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664217.431845:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.440217:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222189184 00000100:00100000:2.0:1788664217.440232:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222189184 00000100:00100000:2.0:1788664217.440293:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788664217.440303:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222189184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.440598:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222189184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (8831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.440613:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788664217.440709:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664217.441458:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8482:1875550222189312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664217.441515:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664217.441555:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c60150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664217.441620:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222189312 00000100:00100000:3.0:1788664217.441627:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222189312 00000100:00100000:3.0:1788664217.441745:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788664217.441754:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8482:x1875550222189312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664217.442001:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8482:x1875550222189312:12345-0@lo:502:llog_process_th.0 Request processed in 248us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664217.442010:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788664217.442080:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8482:1875550222189312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664217.442105:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664217.442115:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664217.442117:0:8482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788664217.442122:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788664217.442142:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8482:1875550222189440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664217.442175:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664217.446366:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222189440 00000100:00100000:0.0:1788664217.446382:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222189440 00000100:00100000:0.0:1788664217.446434:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788664217.446446:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8482:x1875550222189440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664217.446515:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664217.447103:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8482:x1875550222189440:12345-0@lo:502:llog_process_th.0 Request processed in 655us (4924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664217.447113:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788664217.447300:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8482:1875550222189440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664217.447335:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664217.447376:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664217.447378:0:8482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788664217.447384:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788664217.447639:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788664217.447693:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788664217.447703:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.447715:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664217.447724:0:5852:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788664217.447727:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff9b68c3f919c0 from 1 10000000:01000000:0.0:1788664217.447730:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788664217.447774:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.447783:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.447793:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664217.447839:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664217.448035:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664217.448071:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.448115:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222189568 00000100:00100000:2.0:1788664217.448121:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222189568 00000100:00100000:2.0:1788664217.448154:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788664217.448162:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222189568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664217.448173:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664217.448187:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512aa00/0x762f55027be901c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be901b9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.448210:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512aa00/0x762f55027be901c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be901b9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.448220:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512aa00/0x762f55027be901c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901b9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664217.448241:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512aa00, rc 0) 00000100:00100000:2.0:1788664217.448285:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222189568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664217.448292:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788664217.448383:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664217.448397:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.448405:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be901c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664217.448453:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664217.448478:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664217.448495:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664217.448552:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222189696 00000100:00100000:2.0:1788664217.448556:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222189696 00000100:00100000:2.0:1788664217.448574:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788664217.448580:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222189696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664217.449109:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222189696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 527us (628us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664217.449118:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788664217.449186:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222189696:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788664217.449208:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788664217.449214:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664217.449222:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664218.401376:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664219.423741:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664219.936753:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222189824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664219.936877:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664219.936975:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222189824 00000100:00100000:1.0:1788664219.936983:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222189824 00000100:00100000:1.0:1788664219.937042:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664219.937051:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222189824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664219.937090:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664219.937155:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222189824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664219.937163:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788664219.937208:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e06d80 x1875550222189824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664219.937228:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222189824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664219.937807:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664220.095326:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664220.095490:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334848 00000100:00100000:2.0:1788664220.095510:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334848 00000100:00100000:2.0:1788664220.095569:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:2.0:1788664220.095576:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:5602:x1875550204334848:12345-192.168.202.14@tcp:101: 00010000:00010000:2.0:1788664220.095592:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664220.095607:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512a000/0x762f55027be901c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24366a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664220.095632:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512a000/0x762f55027be901c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24366a expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664220.095641:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512a000/0x762f55027be901c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24366a expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664220.095656:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512a000, rc 0) 00000100:00100000:2.0:1788664220.095785:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5602:x1875550204334848:12345-192.168.202.14@tcp:101: Request processed in 209us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664220.095790:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:3.0:1788664220.097873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664220.098003:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204334976 00000100:00100000:1.0:1788664220.098013:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204334976 00000100:00100000:1.0:1788664220.098065:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:1.0:1788664220.098072:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5602:x1875550204334976:12345-192.168.202.14@tcp:501: 00000100:00100000:1.0:1788664220.098335:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5602:x1875550204334976:12345-192.168.202.14@tcp:501: Request processed in 262us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664220.098368:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:1.0:1788664220.100465:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664220.100550:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204335104 00000100:00100000:3.0:1788664220.100559:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204335104 00000100:00100000:3.0:1788664220.100608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:3.0:1788664220.100615:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5602:x1875550204335104:12345-192.168.202.14@tcp:503: 00000100:00100000:3.0:1788664220.100808:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5602:x1875550204335104:12345-192.168.202.14@tcp:503: Request processed in 193us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664220.100814:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:3.0:1788664220.105283:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664220.111097:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204335232 00000100:00100000:2.0:1788664220.111114:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204335232 00000100:00100000:2.0:1788664220.111188:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:2.0:1788664220.111198:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:6087:x1875550204335232:12345-192.168.202.14@tcp:502: 00000100:00100000:2.0:1788664220.111564:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:6087:x1875550204335232:12345-192.168.202.14@tcp:502: Request processed in 366us (6289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664220.111573:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:0.0:1788664220.114398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664220.114496:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204335360 00000100:00100000:1.0:1788664220.114517:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204335360 00000100:00100000:1.0:1788664220.114574:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:1.0:1788664220.114584:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:6087:x1875550204335360:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664220.115051:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:6087:x1875550204335360:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 466us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664220.115060:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:1.0:1788664220.122884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664220.123186:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204335488 00000100:00100000:2.0:1788664220.123196:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204335488 00000100:00100000:2.0:1788664220.123255:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:2.0:1788664220.123265:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5602:x1875550204335488:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664220.123283:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664220.123300:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512b800/0x762f55027be901ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243671 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664220.123331:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512b800/0x762f55027be901ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243671 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664220.123374:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512b800/0x762f55027be901ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243671 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664220.123384:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b800, rc 0) 00000100:00100000:2.0:1788664220.123435:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204335488:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 172us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664220.123459:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:2.0:1788664220.131100:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664220.131242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204335616 00000100:00100000:3.0:1788664220.131254:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204335616 00000100:00100000:3.0:1788664220.131312:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 172 00000100:00100000:3.0:1788664220.131321:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204335616:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664220.131653:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204335616:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 331us (564us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664220.131662:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 172 00010000:00010000:1.0:1788664220.449247:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664220.599172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664220.599221:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664220.599253:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664220.599285:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204335872 00000100:00100000:3.0:1788664220.599295:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204335872 00000100:00100000:3.0:1788664220.599385:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336000 00000100:00100000:3.0:1788664220.599389:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336000 00000100:00100000:3.0:1788664220.599428:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:3.0:1788664220.599438:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204335872:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664220.599523:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204335872:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664220.599531:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:3.0:1788664220.599548:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:3.0:1788664220.599555:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204336000:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664220.599582:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204336000:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664220.599590:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00080000:3.0:1788664220.599608:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664220.599612:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664220.599685:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204335744 00000100:00100000:1.0:1788664220.599689:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204335744 00000100:00100000:1.0:1788664220.599756:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:1.0:1788664220.599765:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204335744:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664220.599799:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204335744:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 36us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664220.599806:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00080000:3.0:1788664220.601965:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788664221.088036:0:8521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5bcb4a50 20000000:00000080:3.0:1788664221.088056:0:8521:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b68dfc3d000 uarg=0000000000000000 20000000:01000000:3.0:1788664221.088127:0:8521:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788664221.088134:0:8521:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788664221.088138:0:8521:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788664221.093655:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788664221.093856:0:8521:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788664221.098184:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788664221.098258:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788664221.098311:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788664221.098327:0:8521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788664221.100589:0:8521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100615:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c1479200/0x762f55027be8ff4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ff43 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100646:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100653:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be90070 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100663:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100672:0:8521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100718:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100734:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 9 pid: 5849 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664221.100748:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222189952:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664221.100912:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be90070 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.100921:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be90070 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664221.100930:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222190080:0@lo:104: 00000100:00100000:3.0:1788664221.100973:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664221.101004:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.101018:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 18 pid: 5849 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664221.101027:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222190208:0@lo:104: 00000100:00100000:3.0:1788664221.101052:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664221.101092:0:5839:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788664221.101104:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190080 00000100:00100000:3.0:1788664221.101111:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190080 00000100:00100000:3.0:1788664221.101154:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190208 00000100:00100000:3.0:1788664221.101156:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190208 00000100:00100000:3.0:1788664221.101169:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788664221.101178:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:8521:x1875550222190080:12345-0@lo:104: 00010000:00010000:3.0:1788664221.101192:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.101265:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788664221.101271:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:8521:x1875550222190080:12345-0@lo:104: Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664221.101278:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788664221.101309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664221.101316:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:8521:x1875550222190208:12345-0@lo:104: 00010000:00010000:3.0:1788664221.101323:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.101377:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788664221.101382:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc40450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:8521:x1875550222190208:12345-0@lo:104: Request processed in 67us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664221.101397:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788664221.101452:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c1479200/0x762f55027be8ff4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be8ff43 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.101462:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c1479200/0x762f55027be8ff4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be8ff43 expref: 18 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664221.101470:0:8521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222190336:0@lo:104: 00000100:00100000:3.0:1788664221.101493:0:8521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664221.101513:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190336 00000100:00100000:3.0:1788664221.101516:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190336 00000100:00100000:3.0:1788664221.101532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664221.101538:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:8521:x1875550222190336:12345-0@lo:104: 00010000:00010000:3.0:1788664221.101545:0:5839:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.101577:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788664221.101582:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:8521:x1875550222190336:12345-0@lo:104: Request processed in 45us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664221.101588:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788664221.101607:0:8521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788664221.101630:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222190080:0@lo:104: 00000100:00100000:3.0:1788664221.101640:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222190208:0@lo:104: 00000100:00100000:3.0:1788664221.101645:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222190336:0@lo:104: 00010000:00010000:0.0:1788664221.101794:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788664221.101802:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101820:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664221.101824:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101832:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664221.101838:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664221.101842:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664221.101879:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101886:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664221.101908:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101915:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c147a600/0x762f55027be90070 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90077 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101929:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664221.101932:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101937:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664221.101939:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101956:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664221.101962:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664221.101967:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664221.101980:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101985:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664221.101991:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.101997:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be8ffa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ffac expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.102007:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664221.102009:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.102014:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215a800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664221.102017:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.102022:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664221.102028:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664221.102039:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664221.102053:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.102059:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664221.102076:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.102083:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215a800/0x762f55027be8ff43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be8ff4a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.102097:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664221.102099:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664221.102100:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664221.102113:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222190464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664221.102146:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664221.103730:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664221.103751:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222190592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664221.103817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664221.103890:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222190720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664221.103913:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664221.103950:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190464 00000100:00100000:0.0:1788664221.103958:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190464 00010000:00010000:0.0:1788664221.103999:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be90070 expref: 19 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664221.104026:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190592 00000100:00100000:0.0:1788664221.104028:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190592 00010000:00010000:0.0:1788664221.104055:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 20 pid: 5849 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664221.104066:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190720 00000100:00100000:0.0:1788664221.104069:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190720 00010000:00010000:0.0:1788664221.104078:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c1479200/0x762f55027be8ff4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff43 expref: 21 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664221.104092:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788664221.104099:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+21:3307:x1875550222190464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664221.104112:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664221.104116:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be90070 expref: 21 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104125:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be90070 expref: 21 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104142:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147a400/0x762f55027be90077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be90070 expref: 21 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104159:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664221.104192:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+20:3307:x1875550222190464:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664221.104213:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788664221.104232:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664221.104238:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222190592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664221.104246:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664221.104250:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 19 pid: 5849 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104268:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 19 pid: 5849 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104277:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215a000/0x762f55027be8ffac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ffa5 expref: 19 pid: 5849 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104286:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664221.104309:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:3307:x1875550222190592:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664221.104315:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664221.104328:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664221.104333:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:3309:x1875550222190720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664221.104380:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664221.104386:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c1479200/0x762f55027be8ff4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be8ff43 expref: 17 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104394:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c1479200/0x762f55027be8ff4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be8ff43 expref: 17 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104403:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479200/0x762f55027be8ff4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be8ff43 expref: 17 pid: 5847 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.104415:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664221.104439:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3309:x1875550222190720:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664221.104446:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664221.104484:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222190720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664221.104508:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222190592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664221.104525:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222190464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664221.104558:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664221.104564:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664221.112862:0:8521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1875550222189952:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664221.112901:0:8521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664221.113836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664221.113928:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336128 00000100:00100000:1.0:1788664221.113937:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336128 00010000:00010000:1.0:1788664221.113980:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 10 pid: 5849 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664221.114025:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:1.0:1788664221.114036:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204336128:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664221.114054:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664221.114061:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 10 pid: 5849 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114074:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 10 pid: 5849 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114093:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b800/0x762f55027be90134 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243639 expref: 10 pid: 5849 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114113:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114121:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114139:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114159:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114166:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114173:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114179:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664221.114184:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114191:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114235:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664221.114258:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664221.114323:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:2360:x1875550204336128:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 289us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664221.114331:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00010000:00010000:3.0:1788664221.114502:0:8521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.114513:0:8521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664221.114527:0:8521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b400/0x762f55027be901d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664221.471635:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664221.472245:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222190976:0@lo:400:kworker.0 00000100:00100000:1.0:1788664221.472320:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222191232:0@lo:400:kworker.0 00000100:00100000:2.0:1788664221.472338:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664221.472387:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664221.472430:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664221.472437:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222191104:0@lo:400:kworker.0 00000100:00100000:0.0:1788664221.472464:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222190848:0@lo:400:kworker.0 00000100:00100000:2.0:1788664221.472477:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664221.472494:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664221.472512:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222191104 00000100:00100000:0.0:1788664221.472513:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222191360:0@lo:400:kworker.0 00000100:00100000:2.0:1788664221.472519:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222191104 00000100:00100000:0.0:1788664221.472533:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664221.472576:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222191360 00000100:00100000:2.0:1788664221.472579:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222191360 00000100:00100000:0.0:1788664221.472581:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190976 00000100:00100000:0.0:1788664221.472583:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190976 00000100:00100000:2.0:1788664221.472602:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664221.472608:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222191232 00000100:00100000:0.0:1788664221.472610:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222191232 00000100:00100000:0.0:1788664221.472622:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222190848 00000100:00100000:2.0:1788664221.472623:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222191104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664221.472624:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222190848 00000100:00100000:0.0:1788664221.472634:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788664221.472639:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222190976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664221.472673:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222191104:12345-0@lo:400:kworker.0 Request processed in 51us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664221.472673:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222190976:12345-0@lo:400:kworker.0 Request processed in 33us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664221.472682:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664221.472682:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664221.472698:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788664221.472698:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788664221.472704:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222191360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664221.472705:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222191232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664221.472730:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222191232:12345-0@lo:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664221.472732:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222191360:12345-0@lo:400:kworker.0 Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664221.472736:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788664221.472746:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664221.472751:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222190848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664221.472760:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788664221.472777:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664221.472780:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222190848:12345-0@lo:400:kworker.0 Request processed in 29us (286us total) trans 0 rc 0/0 00000100:00080000:2.0:1788664221.472782:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664221.472784:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664221.472786:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788664221.472817:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612ed80 x1875550222191104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664221.472819:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222190848:0@lo:400:kworker.0 00010000:00080000:0.0:1788664221.472829:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612c700 x1875550222191360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664221.472840:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222191104:0@lo:400:kworker.0 00000100:00100000:0.0:1788664221.472840:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222191360:0@lo:400:kworker.0 00000100:00100000:2.0:1788664221.472850:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222190976:0@lo:400:kworker.0 00000100:00100000:1.0:1788664221.474622:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222191232:0@lo:400:kworker.0 00000100:00100000:0.0:1788664221.584866:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664221.585206:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336256 00000100:00100000:2.0:1788664221.585217:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336256 00000100:00100000:2.0:1788664221.585286:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:2.0:1788664221.585297:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:5602:x1875550204336256:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664221.585315:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664221.585337:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243678 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664221.585399:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664221.585411:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664221.585422:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b400, rc 0) 00000100:00100000:2.0:1788664221.585480:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204336256:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 185us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664221.585487:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:2.0:1788664221.588948:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664221.588984:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336384 00000100:00100000:2.0:1788664221.588993:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336384 00000100:00100000:2.0:1788664221.589052:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00100000:2.0:1788664221.589064:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204336384:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664221.589519:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204336384:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 456us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664221.589527:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00100000:2.0:1788664221.592079:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664221.592769:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336512 00000100:00100000:0.0:1788664221.592851:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336512 00000100:00100000:0.0:1788664221.592978:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:0.0:1788664221.592990:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204336512:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664221.593997:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:5602:x1875550204336512:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 1004us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664221.594008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:0.0:1788664221.613923:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664221.614289:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336640 00000100:00100000:3.0:1788664221.614309:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336640 00000100:00100000:3.0:1788664221.614396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:3.0:1788664221.614405:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:6144:x1875550204336640:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664221.614654:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:6144:x1875550204336640:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 249us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664221.614663:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:2.0:1788664221.629030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664221.629156:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336768 00000100:00100000:0.0:1788664221.629165:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336768 00000100:00100000:0.0:1788664221.629214:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:0.0:1788664221.629221:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:6144:x1875550204336768:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664221.629663:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:6144:x1875550204336768:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 440us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664221.629671:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:2.0:1788664221.995202:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222191488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664221.995279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664221.995477:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222191488 00000100:00100000:3.0:1788664221.995485:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222191488 00000100:00100000:3.0:1788664221.995533:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664221.995541:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222191488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664221.995579:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664221.995623:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222191488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664221.995630:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788664221.995933:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612e680 x1875550222191488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664221.995954:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222191488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788664222.506482:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788664222.943430:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664222.943438:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68c343c800 from 4 10000000:01000000:3.0:1788664222.943443:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664222.943504:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.943517:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.943549:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664222.943577:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222191616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.943679:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.943743:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664222.943817:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222191616 00000100:00100000:1.0:1788664222.943826:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222191616 00000100:00100000:1.0:1788664222.943894:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788664222.943903:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222191616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664222.943919:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664222.943934:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be901e3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664222.943965:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be901e3 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664222.943978:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901e3 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664222.944107:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478200, rc 0) 00000100:00100000:1.0:1788664222.944230:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222191616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664222.944237:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788664222.945214:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222191616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664222.945240:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.945251:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664222.945336:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222191744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.945434:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.945471:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664222.946338:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222191744 00000100:00100000:0.0:1788664222.946391:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222191744 00000100:00100000:0.0:1788664222.946443:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788664222.946453:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222191744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664222.946802:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222191744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664222.946811:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788664222.947821:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222191744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.947882:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222191872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.947947:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.948063:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664222.948478:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222191872 00000100:00100000:0.0:1788664222.948495:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222191872 00000100:00100000:0.0:1788664222.948609:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788664222.948620:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222191872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664222.948828:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222191872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664222.948836:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788664222.948919:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222191872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.952706:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8600:1875550222192000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.952808:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.952856:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664222.952927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192000 00000100:00100000:2.0:1788664222.952934:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192000 00000100:00100000:2.0:1788664222.952989:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788664222.953001:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8600:x1875550222192000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664222.953617:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8600:x1875550222192000:12345-0@lo:502:llog_process_th.0 Request processed in 617us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664222.953627:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788664222.953766:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8600:1875550222192000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664222.953796:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664222.953805:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664222.953808:0:8600:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788664222.953815:0:8600:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68c343c800 00000020:00000080:3.0:1788664222.953817:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788664222.953893:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8600:1875550222192128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.953930:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.953996:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664222.957712:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192128 00000100:00100000:0.0:1788664222.957730:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192128 00000100:00100000:0.0:1788664222.957809:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788664222.957820:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8600:x1875550222192128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664222.958102:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:8600:x1875550222192128:12345-0@lo:502:llog_process_th.0 Request processed in 272us (4160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664222.958110:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788664222.960444:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8600:1875550222192128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664222.960503:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664222.960512:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664222.960514:0:8600:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788664222.960519:0:8600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788664222.960956:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788664222.960980:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664222.960990:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664222.961002:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664222.961023:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788664222.961026:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68f8b62000 from 4 10000000:01000000:0.0:1788664222.961029:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664222.961063:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664222.961070:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664222.961079:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664222.961112:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664222.961184:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664222.961224:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e7f1cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.961810:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192256 00000100:00100000:3.0:1788664222.961818:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192256 00000100:00100000:3.0:1788664222.961867:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788664222.961876:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222192256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664222.963258:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664222.963284:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be901f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.963318:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be901f1 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.963532:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901f1 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.963543:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b400, rc 0) 00000100:00100000:3.0:1788664222.963642:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222192256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1765us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.963653:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788664222.963820:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664222.963841:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664222.963851:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664222.963923:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664222.963958:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664222.963994:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e7f1cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.970144:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192384 00000100:00100000:3.0:1788664222.970166:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192384 00000100:00100000:3.0:1788664222.970248:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788664222.970260:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222192384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.973802:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222192384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3537us (9835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.973816:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788664222.973959:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.974025:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.974072:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.974121:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.974140:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192512 00000100:00100000:3.0:1788664222.974147:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192512 00000100:00100000:3.0:1788664222.974193:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788664222.974201:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222192512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.974625:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222192512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 424us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.974634:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788664222.974680:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.974967:0:8603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8603:1875550222192640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.975008:0:8603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.975031:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192640 00000100:00100000:3.0:1788664222.975041:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192640 00000100:00100000:3.0:1788664222.975065:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788664222.975072:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8603:x1875550222192640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.975438:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8603:x1875550222192640:12345-0@lo:502:llog_process_th.0 Request processed in 365us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.975446:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788664222.975481:0:8603:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.975495:0:8603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8603:1875550222192640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664222.975528:0:8603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664222.975538:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664222.975540:0:8603:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788664222.975546:0:8603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68f8b62000 00000020:00000080:3.0:1788664222.975549:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788664222.975630:0:8603:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8603:1875550222192768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.975664:0:8603:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.975683:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192768 00000100:00100000:3.0:1788664222.975687:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192768 00000100:00100000:3.0:1788664222.975707:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788664222.975713:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8603:x1875550222192768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.975819:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:8603:x1875550222192768:12345-0@lo:502:llog_process_th.0 Request processed in 105us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.975826:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788664222.975852:0:8603:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.975972:0:8603:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8603:1875550222192768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664222.975989:0:8603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664222.975994:0:8603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664222.976000:0:8603:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788664222.976004:0:8603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788664222.976059:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788664222.976075:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664222.976085:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.976097:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664222.976121:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664222.976124:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68d438d000 from 4 10000000:01000000:3.0:1788664222.976127:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664222.976150:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.976231:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.976240:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664222.976252:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.976278:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.976291:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.976303:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222192896 00000100:00100000:3.0:1788664222.976306:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222192896 00000100:00100000:3.0:1788664222.976325:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788664222.976418:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222192896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664222.976429:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664222.976448:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be901ff expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.976469:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be901ff expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.976481:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901ff expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.976489:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b800, rc 0) 00000100:00100000:3.0:1788664222.976528:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222192896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.976534:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788664222.976567:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222192896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664222.976579:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664222.976587:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664222.976626:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222193024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.976650:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.976662:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.976673:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193024 00000100:00100000:3.0:1788664222.976676:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193024 00000100:00100000:3.0:1788664222.976696:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788664222.976701:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222193024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.976909:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222193024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.976921:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788664222.976955:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222193024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.976979:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222193152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.977011:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.977024:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.977034:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193152 00000100:00100000:3.0:1788664222.977038:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193152 00000100:00100000:3.0:1788664222.977057:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788664222.977062:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222193152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.980544:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222193152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3471us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664222.980559:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788664222.980656:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222193152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664222.981642:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8604:1875550222193280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.981707:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.981752:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664222.981822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193280 00000100:00100000:1.0:1788664222.981829:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193280 00000100:00100000:1.0:1788664222.981876:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788664222.981887:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:8604:x1875550222193280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664222.983275:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:8604:x1875550222193280:12345-0@lo:502:llog_process_th.0 Request processed in 1382us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664222.983288:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788664222.983506:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8604:1875550222193280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664222.983560:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664222.983570:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664222.983573:0:8604:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788664222.983580:0:8604:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68d438d000 00000020:00000080:3.0:1788664222.983583:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788664222.983688:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8604:1875550222193408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.983744:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664222.983779:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193408 00000100:00100000:3.0:1788664222.983785:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193408 00000100:00100000:2.0:1788664222.987522:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f8bfb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664222.994844:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788664222.994862:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:8604:x1875550222193408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664222.995723:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:8604:x1875550222193408:12345-0@lo:502:llog_process_th.0 Request processed in 863us (11975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664222.995764:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:8604:1875550222193408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788664222.995803:0:8604:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664222.995817:0:8604:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664222.995819:0:8604:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788664222.995826:0:8604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788664222.998816:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788664222.998847:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664222.998860:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664222.998873:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664223.013025:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00010000:0.0:1788664223.523104:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664224.544574:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664225.061181:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664225.061204:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222193536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664225.061283:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664225.061489:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193536 00000100:00100000:3.0:1788664225.061499:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193536 00000100:00100000:3.0:1788664225.061575:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788664225.061585:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222193536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664225.061625:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664225.061674:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222193536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664225.061680:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788664225.061726:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1fb80 x1875550222193536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664225.061748:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222193536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664225.061899:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664225.572038:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664225.721730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664225.721768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664225.721793:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664225.721813:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664225.721842:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204336896 00000100:00100000:0.0:1788664225.721853:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204336896 00000100:00100000:0.0:1788664225.721904:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:0.0:1788664225.721915:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204336896:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664225.721984:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204336896:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 72us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664225.721992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:0.0:1788664225.722024:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337152 00000100:00100000:0.0:1788664225.722027:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337152 00000100:00100000:0.0:1788664225.722063:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337280 00000100:00100000:0.0:1788664225.722066:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337280 00000100:00100000:0.0:1788664225.722086:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:0.0:1788664225.722092:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204337152:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664225.722120:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204337152:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664225.722126:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:0.0:1788664225.722137:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788664225.722143:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204337280:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664225.722177:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204337280:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664225.722184:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788664225.722201:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337024 00000100:00100000:0.0:1788664225.722205:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337024 00000100:00100000:0.0:1788664225.722235:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:0.0:1788664225.722242:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204337024:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664225.722267:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204337024:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664225.722273:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00080000:0.0:1788664225.722448:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664225.722453:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664225.722455:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788664226.594603:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664226.599906:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222193920:0@lo:400:kworker.0 00000100:00100000:1.0:1788664226.599978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664226.600064:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664226.600072:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222194048:0@lo:400:kworker.0 00000100:00100000:1.0:1788664226.600100:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664226.600143:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193920 00000100:00100000:1.0:1788664226.600150:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193920 00000100:00100000:1.0:1788664226.600203:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664226.600213:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222193920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664226.600264:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222193920:12345-0@lo:400:kworker.0 Request processed in 52us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664226.600271:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664226.600295:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194048 00000100:00100000:1.0:1788664226.600299:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194048 00000100:00100000:1.0:1788664226.600324:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788664226.600330:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222194048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664226.600384:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222194048:12345-0@lo:400:kworker.0 Request processed in 54us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664226.600390:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788664226.600406:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664226.600438:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f18380 x1875550222194048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664226.600452:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222194048:0@lo:400:kworker.0 00000100:00100000:1.0:1788664226.600465:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222193920:0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.600650:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222193664:0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.600687:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664226.600719:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222194176:0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.600742:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664226.600762:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788664226.600768:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222193792:0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.600790:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664226.600807:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222194304:0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.600827:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664226.600853:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194176 00000100:00100000:2.0:1788664226.600857:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194176 00000100:00100000:2.0:1788664226.600883:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193792 00000100:00100000:2.0:1788664226.600886:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193792 00000100:00100000:2.0:1788664226.600901:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664226.600907:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222194176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.600947:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222194176:12345-0@lo:400:kworker.0 Request processed in 40us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664226.600954:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788664226.600965:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664226.600970:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222193792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.600994:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222193792:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664226.601000:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788664226.601020:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194304 00000100:00100000:2.0:1788664226.601031:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194304 00000100:00100000:2.0:1788664226.601082:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664226.601088:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222194304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.601119:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222194304:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664226.601126:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664226.601154:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222193792:0@lo:400:kworker.0 00010000:00080000:2.0:1788664226.601164:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1ad80 x1875550222194304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664226.601174:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222194304:0@lo:400:kworker.0 00000100:00100000:2.0:1788664226.601183:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222194176:0@lo:400:kworker.0 00000100:00100000:1.0:1788664226.602646:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222193664 00000100:00100000:1.0:1788664226.602657:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222193664 00000100:00100000:1.0:1788664226.602705:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788664226.602714:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222193664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664226.602774:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222193664:12345-0@lo:400:kworker.0 Request processed in 62us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664226.602782:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1788664226.602817:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664226.602822:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664226.602894:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222193664:0@lo:400:kworker.0 00000100:00100000:0.0:1788664227.103591:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664227.103616:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222194432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664227.103689:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664227.103760:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194432 00000100:00100000:0.0:1788664227.103768:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194432 00000100:00100000:0.0:1788664227.103824:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788664227.103833:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222194432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664227.103869:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664227.103914:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222194432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664227.103921:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788664227.103979:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e05880 x1875550222194432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664227.104022:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222194432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664227.621319:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664228.089769:0:8821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788664228.640046:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664229.672706:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664230.176703:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664230.176727:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222194560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664230.176797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664230.177067:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194560 00000100:00100000:0.0:1788664230.177076:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194560 00000100:00100000:0.0:1788664230.177234:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788664230.177244:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222194560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664230.177300:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664230.177382:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222194560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664230.177391:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788664230.177671:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664230.178669:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1fb80 x1875550222194560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664230.178690:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222194560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664230.688686:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664230.843886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664230.843994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664230.844033:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664230.844065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664230.844094:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337664 00000100:00100000:0.0:1788664230.844115:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337664 00000100:00100000:0.0:1788664230.844185:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337792 00000100:00100000:0.0:1788664230.844189:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337792 00000100:00100000:0.0:1788664230.844210:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788664230.844219:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2357:x1875550204337664:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:0.0:1788664230.844258:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90142 00000100:00080000:0.0:1788664230.844267:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b68f85de800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664230.844307:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788664230.844725:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+2:2357:x1875550204337664:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 505us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664230.844734:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788664230.844767:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788664230.844774:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2357:x1875550204337792:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:0.0:1788664230.844789:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90149 00000100:00080000:0.0:1788664230.844796:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b68f808c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664230.844818:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788664230.845000:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+2:2357:x1875550204337792:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 225us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664230.845007:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00010000:00010000:0.0:1788664230.845031:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664230.845154:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664230.845747:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337408 00000100:00100000:3.0:1788664230.845756:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337408 00000100:00100000:3.0:1788664230.845812:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 195 00000100:00100000:3.0:1788664230.845821:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2359:x1875550204337408:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664230.845871:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2359:x1875550204337408:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 51us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664230.845889:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 195 00000100:00080000:3.0:1788664230.845925:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664230.845931:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664230.847450:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337536 00000100:00100000:2.0:1788664230.847462:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337536 00000100:00100000:2.0:1788664230.847576:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788664230.847598:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2359:x1875550204337536:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664230.847673:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2359:x1875550204337536:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 86us (3798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664230.847691:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00080000:3.0:1788664230.848260:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788664231.712313:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664231.716804:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222194816:0@lo:400:kworker.0 00000100:00100000:1.0:1788664231.717067:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222194688:0@lo:400:kworker.0 00000100:00100000:1.0:1788664231.717190:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664231.717260:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222195200:0@lo:400:kworker.0 00000100:00100000:1.0:1788664231.717292:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664231.717368:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195200 00000100:00100000:1.0:1788664231.717376:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195200 00000100:00100000:1.0:1788664231.717444:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664231.717455:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222195200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664231.718630:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194688 00000100:00100000:2.0:1788664231.718644:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194688 00000100:00100000:2.0:1788664231.718693:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788664231.718702:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222194688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664231.718764:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222194688:12345-0@lo:400:kworker.0 Request processed in 63us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664231.718771:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788664231.719120:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664231.719169:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222195328:0@lo:400:kworker.0 00000100:00100000:3.0:1788664231.719201:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664231.719201:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194816 00000100:00100000:2.0:1788664231.719205:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194816 00000100:00100000:2.0:1788664231.719234:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664231.719241:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222194816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664231.719283:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222194816:12345-0@lo:400:kworker.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664231.719289:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664231.719338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222194816:0@lo:400:kworker.0 00000100:00100000:1.0:1788664231.719350:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222195200:12345-0@lo:400:kworker.0 Request processed in 61us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664231.719359:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664231.719394:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222194688:0@lo:400:kworker.0 00000100:00100000:1.0:1788664231.719407:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222195200:0@lo:400:kworker.0 00000100:00100000:3.0:1788664231.719467:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222194944:0@lo:400:kworker.0 00000100:00100000:3.0:1788664231.719645:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664231.719673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664231.719681:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222195072:0@lo:400:kworker.0 00000100:00100000:2.0:1788664231.719705:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222194944 00000100:00100000:2.0:1788664231.719709:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222194944 00000100:00100000:2.0:1788664231.719737:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788664231.719743:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222194944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664231.719776:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222194944:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664231.719780:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664231.719782:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788664231.719848:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222194944:0@lo:400:kworker.0 00000100:00080000:3.0:1788664231.719872:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664231.727865:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195328 00000100:00100000:1.0:1788664231.727901:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195328 00000100:00100000:1.0:1788664231.727986:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195072 00000100:00100000:1.0:1788664231.727989:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195072 00000100:00100000:1.0:1788664231.728023:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664231.728035:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222195328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664231.728133:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222195328:12345-0@lo:400:kworker.0 Request processed in 100us (8930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664231.728141:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664231.729831:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788664231.729849:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222195072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664231.729937:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222195072:12345-0@lo:400:kworker.0 Request processed in 97us (10231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664231.729944:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788664231.731550:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f9021500 x1875550222195328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664231.731568:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222195328:0@lo:400:kworker.0 00010000:00080000:3.0:1788664231.732586:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612f100 x1875550222195072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664231.732612:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222195072:0@lo:400:kworker.0 00000100:00080000:2.0:1788664231.733367:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664232.223698:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664232.223722:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222195456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664232.223822:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664232.223898:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195456 00000100:00100000:0.0:1788664232.223905:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195456 00000100:00100000:0.0:1788664232.223948:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788664232.223956:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222195456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664232.223989:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664232.224031:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222195456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664232.224039:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788664232.224079:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e06300 x1875550222195456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664232.224111:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222195456:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788664232.275008:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:2.0:1788664232.275021:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b68f85da000/5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:3.0:1788664232.275112:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f85da000/5e600724-38bd-4119-be7d-5264f08f0aa5 for lustre-OST0000 00000020:00000080:3.0:1788664232.275187:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f85de800 for lustre-OST0000 00010000:00010000:0.0:1788664232.741366:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664233.768846:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788664233.873698:0:9065:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing yml_node 00010000:00010000:1.0:1788664234.786770:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664235.295860:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222195584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664235.295928:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664235.296111:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195584 00000100:00100000:0.0:1788664235.296120:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195584 00000100:00100000:1.0:1788664235.299900:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788664235.299916:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222195584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664235.299958:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664235.300041:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222195584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (4112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664235.300049:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788664235.300102:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e06300 x1875550222195584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664235.300140:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222195584:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664235.300226:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788664235.344264:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:2.0:1788664235.344276:0:7657:0:(genops.c:885:class_export_put()) final put ffff9b68f8b60800/5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:1.0:1788664235.344481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f8b60800/5e600724-38bd-4119-be7d-5264f08f0aa5 for lustre-OST0001 00000020:00000080:1.0:1788664235.344539:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f808c800 for lustre-OST0001 00010000:00010000:0.0:1788664235.808310:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664235.963181:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664235.963440:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338048 00000100:00100000:1.0:1788664235.963451:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338048 00000100:00100000:1.0:1788664235.963531:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:1.0:1788664235.963542:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204338048:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664235.963624:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204338048:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 84us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664235.963631:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00080000:3.0:1788664235.963691:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664235.967827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664235.967924:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204337920 00000100:00100000:0.0:1788664235.967935:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204337920 00000100:00100000:0.0:1788664235.967994:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 197 00000100:00100000:0.0:1788664235.968003:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2361:x1875550204337920:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664235.968084:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2361:x1875550204337920:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664235.968102:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 197 00010000:00010000:0.0:1788664236.833723:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664236.835075:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222195968:0@lo:400:kworker.0 00000100:00100000:3.0:1788664236.835186:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664236.835269:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664236.835276:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222196096:0@lo:400:kworker.0 00000100:00100000:3.0:1788664236.835305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664236.835449:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195968 00000100:00100000:0.0:1788664236.835458:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195968 00000100:00100000:0.0:1788664236.835523:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788664236.835534:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222195968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664236.835588:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222195968:12345-0@lo:400:kworker.0 Request processed in 56us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664236.835595:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788664236.835735:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222195840:0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.835767:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664236.835796:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222196352:0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.835819:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664236.835843:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664236.835849:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222195712:0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.835874:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664236.835892:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222196224:0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.835914:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664236.835940:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196096 00000100:00100000:2.0:1788664236.835944:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196096 00000100:00100000:2.0:1788664236.835967:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196352 00000100:00100000:2.0:1788664236.835970:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196352 00000100:00100000:2.0:1788664236.835986:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664236.835992:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222196096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.836022:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222196096:12345-0@lo:400:kworker.0 Request processed in 29us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664236.836028:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664236.836040:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664236.836046:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222196352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.836075:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222196352:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664236.836081:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664236.836122:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195840 00000100:00100000:2.0:1788664236.836126:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195840 00000100:00100000:2.0:1788664236.836142:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196224 00000100:00100000:2.0:1788664236.836144:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196224 00000100:00100000:2.0:1788664236.836178:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788664236.836184:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222195840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.836215:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222195840:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664236.836220:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788664236.836231:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788664236.836237:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222196224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.836261:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222196224:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664236.836266:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788664236.836300:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222196224:0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.836310:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222195840:0@lo:400:kworker.0 00010000:00080000:2.0:1788664236.836322:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c60d1180 x1875550222196352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664236.836331:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222196352:0@lo:400:kworker.0 00000100:00100000:3.0:1788664236.836652:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222195712 00000100:00100000:3.0:1788664236.836657:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222195712 00000100:00100000:3.0:1788664236.836702:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788664236.836710:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222195712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664236.836752:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222195712:12345-0@lo:400:kworker.0 Request processed in 44us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664236.836758:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1788664236.836791:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664236.836796:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788664236.836813:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e06300 x1875550222196096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664236.836823:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222196096:0@lo:400:kworker.0 00000100:00100000:3.0:1788664236.836834:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222195968:0@lo:400:kworker.0 00000100:00100000:2.0:1788664236.837061:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222195712:0@lo:400:kworker.0 00000100:00100000:3.0:1788664237.348007:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664237.348030:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222196480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664237.348113:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664237.348194:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196480 00000100:00100000:3.0:1788664237.348202:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196480 00000100:00100000:3.0:1788664237.348245:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788664237.348254:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222196480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664237.348286:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664237.348331:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222196480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664237.348699:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788664237.348746:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b67c722d880 x1875550222196480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664237.348767:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222196480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664237.860467:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788664238.170133:0:9258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.4 00010000:00010000:0.0:1788664238.879624:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664239.903734:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664240.417255:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664240.417279:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222196608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664240.417377:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664240.418910:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196608 00000100:00100000:2.0:1788664240.418924:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196608 00000100:00100000:2.0:1788664240.418998:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664240.419010:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222196608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664240.419049:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664240.419122:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222196608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664240.419129:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788664240.419192:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e04380 x1875550222196608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664240.419213:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222196608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664240.420740:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788664240.872383:0:9356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.4 00010000:00010000:0.0:1788664240.929419:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664241.077588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664241.077626:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664241.077694:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338176 00000100:00100000:3.0:1788664241.077703:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338176 00000100:00100000:3.0:1788664241.077753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 199 00000100:00100000:3.0:1788664241.077763:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204338176:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664241.077833:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204338176:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664241.077841:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 199 00000100:00100000:2.0:1788664241.078045:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338304 00000100:00100000:2.0:1788664241.078050:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338304 00000100:00100000:2.0:1788664241.078183:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788664241.078210:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204338304:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664241.078250:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204338304:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 44us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664241.078256:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00080000:3.0:1788664241.078333:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664241.951715:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222196992:0@lo:400:kworker.0 00000100:00100000:3.0:1788664241.951795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664241.951856:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664241.951863:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222197120:0@lo:400:kworker.0 00000100:00100000:3.0:1788664241.951888:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664241.951932:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196992 00000100:00100000:3.0:1788664241.951942:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196992 00000100:00100000:3.0:1788664241.952006:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788664241.952016:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222196992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664241.952080:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222196992:12345-0@lo:400:kworker.0 Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664241.952101:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788664241.952124:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222197120 00000100:00100000:3.0:1788664241.952128:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222197120 00000100:00100000:3.0:1788664241.952180:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788664241.952187:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222197120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664241.952218:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222197120:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664241.952224:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788664241.952240:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788664241.952273:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b67c722ea00 x1875550222197120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664241.952287:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222197120:0@lo:400:kworker.0 00000100:00100000:3.0:1788664241.952299:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222196992:0@lo:400:kworker.0 00000100:00100000:1.0:1788664241.952432:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222196736:0@lo:400:kworker.0 00000100:00100000:1.0:1788664241.952467:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664241.952499:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222197248:0@lo:400:kworker.0 00000100:00100000:1.0:1788664241.952522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664241.952537:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788664241.952543:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222196864:0@lo:400:kworker.0 00000100:00100000:1.0:1788664241.952563:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664241.952581:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222197376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664241.952602:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664241.952629:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222197376 00000100:00100000:1.0:1788664241.952632:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222197376 00000100:00100000:1.0:1788664241.952663:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788664241.952670:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222197376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664241.952720:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222197376:12345-0@lo:400:kworker.0 Request processed in 51us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664241.952734:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788664241.952763:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b67c722c380 x1875550222197376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664241.952773:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222197376:0@lo:400:kworker.0 00000100:00100000:0.0:1788664241.953005:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222197248 00000100:00100000:0.0:1788664241.953011:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222197248 00000100:00100000:0.0:1788664241.953041:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196864 00000100:00100000:0.0:1788664241.953044:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196864 00000100:00100000:0.0:1788664241.953071:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788664241.953078:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222197248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664241.953117:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222197248:12345-0@lo:400:kworker.0 Request processed in 40us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664241.953123:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788664241.953136:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788664241.953141:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222196864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664241.953178:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222196864:12345-0@lo:400:kworker.0 Request processed in 37us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664241.953184:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788664241.953209:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222196864:0@lo:400:kworker.0 00000100:00100000:0.0:1788664241.953217:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222197248:0@lo:400:kworker.0 00000100:00100000:3.0:1788664241.953709:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222196736 00000100:00100000:3.0:1788664241.953715:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222196736 00000100:00100000:3.0:1788664241.953750:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788664241.953757:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222196736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664241.953839:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222196736:12345-0@lo:400:kworker.0 Request processed in 82us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664241.953845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1788664241.953875:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664241.953880:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788664241.963449:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664241.964227:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222196736:0@lo:400:kworker.0 00000100:00100000:1.0:1788664242.463625:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664242.463650:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222197504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664242.463729:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664242.466408:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222197504 00000100:00100000:3.0:1788664242.466423:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222197504 00000100:00100000:3.0:1788664242.466485:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788664242.466496:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222197504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664242.466554:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664242.466636:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222197504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664242.466644:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788664242.469620:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f19f80 x1875550222197504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664242.469650:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222197504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664242.979729:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788664242.998773:0:9453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.4 00010000:00010000:0.0:1788664244.002870:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664244.725956:0:9501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 23:10:44 EDT 2026 00010000:00010000:0.0:1788664245.026434:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664245.537023:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664245.537047:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222197632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664245.537122:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664245.537231:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222197632 00000100:00100000:3.0:1788664245.537239:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222197632 00000100:00100000:3.0:1788664245.537315:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788664245.537324:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222197632:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664245.538045:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788664245.540892:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664245.541013:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222197632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3684us (3885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664245.541025:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788664245.541378:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b67c722ce00 x1875550222197632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664245.541405:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222197632:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664246.048926:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664246.204944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664246.212589:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664246.212672:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338560 00000100:00100000:2.0:1788664246.212682:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338560 00000100:00100000:2.0:1788664246.212757:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788664246.212768:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204338560:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664246.212840:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204338560:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 74us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664246.212848:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00080000:3.0:1788664246.213278:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664246.219182:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338432 00000100:00100000:1.0:1788664246.219201:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338432 00000100:00100000:1.0:1788664246.220312:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:1.0:1788664246.220330:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204338432:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664246.220427:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204338432:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 103us (15494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664246.220435:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:1.0:1788664247.073170:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222197760:0@lo:400:kworker.0 00000100:00100000:1.0:1788664247.073257:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664247.073307:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222198272:0@lo:400:kworker.0 00000100:00100000:1.0:1788664247.073335:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664247.073381:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788664247.073387:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222197888:0@lo:400:kworker.0 00000100:00100000:1.0:1788664247.073410:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664247.073426:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222198400:0@lo:400:kworker.0 00000100:00100000:1.0:1788664247.073448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664247.073473:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222198016:0@lo:400:kworker.0 00000100:00100000:1.0:1788664247.073495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664247.073511:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664247.073515:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222198144:0@lo:400:kworker.0 00000100:00100000:1.0:1788664247.073550:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664247.074318:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198272 00000100:00100000:2.0:1788664247.074334:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198272 00000100:00100000:2.0:1788664247.074415:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222197888 00000100:00100000:2.0:1788664247.074419:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222197888 00000100:00100000:2.0:1788664247.074435:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198016 00000100:00100000:2.0:1788664247.074437:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198016 00000100:00100000:2.0:1788664247.074453:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788664247.074462:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.074533:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222198272:12345-0@lo:400:kworker.0 Request processed in 71us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664247.074541:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788664247.074571:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788664247.074578:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222197888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.074606:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222197888:12345-0@lo:400:kworker.0 Request processed in 29us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664247.074611:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788664247.074623:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788664247.074630:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222198016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.074661:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222198016:12345-0@lo:400:kworker.0 Request processed in 32us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664247.074666:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788664247.074715:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664247.074750:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222197888:0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.074761:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222198272:0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.074790:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222198016:0@lo:400:kworker.0 00000100:00100000:0.0:1788664247.075386:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222197760 00000100:00100000:0.0:1788664247.075392:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222197760 00000100:00100000:0.0:1788664247.075423:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788664247.075430:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222197760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664247.075473:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222197760:12345-0@lo:400:kworker.0 Request processed in 44us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664247.075480:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00010000:0.0:1788664247.075508:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664247.075679:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222197760:0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.077693:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198400 00000100:00100000:2.0:1788664247.077705:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198400 00000100:00100000:2.0:1788664247.077773:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198144 00000100:00100000:2.0:1788664247.077776:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198144 00000100:00100000:2.0:1788664247.077802:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664247.077812:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222198400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.077889:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222198400:12345-0@lo:400:kworker.0 Request processed in 79us (4439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664247.077896:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664247.077911:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664247.077917:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222198144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664247.077950:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222198144:12345-0@lo:400:kworker.0 Request processed in 33us (4399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664247.077955:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788664247.077999:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1aa00 x1875550222198144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664247.078012:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222198144:0@lo:400:kworker.0 00010000:00080000:2.0:1788664247.078046:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f9021500 x1875550222198400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664247.078056:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222198400:0@lo:400:kworker.0 00000100:00080000:0.0:1788664247.078121:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664247.078126:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664247.584127:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664247.584163:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222198528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664247.584247:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664247.584684:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198528 00000100:00100000:3.0:1788664247.584694:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198528 00000100:00100000:3.0:1788664247.584753:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788664247.584764:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222198528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664247.584803:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664247.584875:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222198528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664247.584899:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788664247.585106:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f2b480 x1875550222198528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664247.585125:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222198528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664248.096125:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664249.120556:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664250.148831:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664250.655611:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222198656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664250.655682:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664250.655758:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198656 00000100:00100000:1.0:1788664250.655765:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198656 00000100:00100000:1.0:1788664250.655818:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788664250.655835:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222198656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664250.655871:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664250.655914:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222198656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664250.655921:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788664250.655959:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f2b480 x1875550222198656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664250.655978:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222198656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664250.657462:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788664251.177753:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664251.327767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664251.327813:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664251.327843:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338816 00000100:00100000:2.0:1788664251.327853:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338816 00000100:00100000:2.0:1788664251.327912:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:2.0:1788664251.327937:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204338816:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664251.328010:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204338816:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664251.328018:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00080000:2.0:1788664251.328054:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664251.328569:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338688 00000100:00100000:3.0:1788664251.328576:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338688 00000100:00100000:3.0:1788664251.328624:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:3.0:1788664251.329119:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204338688:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664251.329182:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204338688:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 550us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664251.329190:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:1.0:1788664252.191796:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222199040:0@lo:400:kworker.0 00000100:00100000:1.0:1788664252.191901:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664252.191971:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664252.191978:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222199168:0@lo:400:kworker.0 00000100:00100000:1.0:1788664252.192008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664252.193372:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222198784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.193459:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664252.193506:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222199296:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.193544:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664252.193579:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788664252.193587:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222198912:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.193611:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664252.193629:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222199424:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.193653:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664252.193683:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199168 00000100:00100000:2.0:1788664252.193691:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199168 00000100:00100000:2.0:1788664252.193754:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199424 00000100:00100000:2.0:1788664252.193758:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199424 00000100:00100000:2.0:1788664252.193781:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664252.193790:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222199168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.193847:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222199168:12345-0@lo:400:kworker.0 Request processed in 58us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664252.193855:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664252.193872:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664252.193878:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222199424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.193908:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222199424:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664252.193928:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664252.193949:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199040 00000100:00100000:2.0:1788664252.193952:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199040 00000100:00100000:2.0:1788664252.193978:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199296 00000100:00100000:2.0:1788664252.193981:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199296 00000100:00100000:2.0:1788664252.193994:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198912 00000100:00100000:2.0:1788664252.193997:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198912 00000100:00100000:2.0:1788664252.194012:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664252.194020:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222199040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.194071:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222199040:12345-0@lo:400:kworker.0 Request processed in 52us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664252.194078:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664252.194090:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664252.194095:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222199296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.194122:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222199296:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664252.194128:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788664252.194139:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664252.194145:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222198912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.194185:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222198912:12345-0@lo:400:kworker.0 Request processed in 40us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664252.194190:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788664252.194214:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664252.194218:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664252.194221:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788664252.194277:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788664252.194310:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f29880 x1875550222199168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664252.194334:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222199168:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.194380:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222199040:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.194436:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222198912:0@lo:400:kworker.0 00010000:00080000:2.0:1788664252.194448:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f29180 x1875550222199424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664252.194456:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222199424:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.194465:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222199296:0@lo:400:kworker.0 00000100:00100000:1.0:1788664252.196825:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222198784 00000100:00100000:1.0:1788664252.196838:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222198784 00000100:00100000:1.0:1788664252.196906:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788664252.196919:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222198784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664252.197000:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222198784:12345-0@lo:400:kworker.0 Request processed in 84us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664252.197007:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788664252.197097:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222198784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664252.716723:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222199552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664252.716820:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664252.717016:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199552 00000100:00100000:1.0:1788664252.717027:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199552 00000100:00100000:1.0:1788664252.717087:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664252.717098:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222199552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664252.717141:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664252.717225:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222199552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664252.717233:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788664252.717286:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1aa00 x1875550222199552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664252.717307:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222199552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788664253.217100:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664254.240493:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664255.263576:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664255.778865:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222199680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664255.778958:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664255.779154:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199680 00000100:00100000:2.0:1788664255.779173:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199680 00000100:00100000:2.0:1788664255.779252:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664255.779264:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222199680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664255.779321:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664255.779420:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222199680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664255.779428:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788664255.780264:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664255.780326:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1ad80 x1875550222199680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664255.780367:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222199680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664256.287897:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664256.459379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664256.459453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664256.459520:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204338944 00000100:00100000:2.0:1788664256.459533:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204338944 00000100:00100000:2.0:1788664256.459600:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:2.0:1788664256.459612:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204338944:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664256.459708:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204338944:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 99us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664256.459717:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:2.0:1788664256.459762:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339072 00000100:00100000:2.0:1788664256.459766:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339072 00000100:00100000:2.0:1788664256.459809:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:2.0:1788664256.459816:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204339072:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664256.459847:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204339072:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664256.459854:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00080000:2.0:1788664256.460007:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788664257.311495:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664257.328085:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222200192:0@lo:400:kworker.0 00000100:00100000:1.0:1788664257.328212:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664257.328304:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664257.328311:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222200064:0@lo:400:kworker.0 00000100:00100000:1.0:1788664257.328366:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664257.328408:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200192 00000100:00100000:1.0:1788664257.328417:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200192 00000100:00100000:1.0:1788664257.328503:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664257.328518:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222200192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664257.328588:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222200192:12345-0@lo:400:kworker.0 Request processed in 73us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664257.328595:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664257.328624:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200064 00000100:00100000:1.0:1788664257.328647:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200064 00000100:00100000:1.0:1788664257.328679:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788664257.328685:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222200064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664257.328718:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222200064:12345-0@lo:400:kworker.0 Request processed in 33us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664257.328725:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788664257.328742:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664257.328747:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664257.328789:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222200064:0@lo:400:kworker.0 00010000:00080000:1.0:1788664257.328805:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f28000 x1875550222200192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664257.328815:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222200192:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329320:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222199808:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329391:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664257.329428:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222200320:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329455:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664257.329481:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788664257.329487:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222199936:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329511:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664257.329530:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222200448:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329553:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664257.329587:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200320 00000100:00100000:0.0:1788664257.329593:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200320 00000100:00100000:0.0:1788664257.329633:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199936 00000100:00100000:0.0:1788664257.329636:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199936 00000100:00100000:0.0:1788664257.329652:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788664257.329658:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222200320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329703:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222200320:12345-0@lo:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664257.329710:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788664257.329727:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788664257.329732:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222199936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329758:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222199936:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664257.329764:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788664257.329781:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222199808 00000100:00100000:0.0:1788664257.329796:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222199808 00000100:00100000:0.0:1788664257.329825:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788664257.329831:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222199808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329862:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222199808:12345-0@lo:400:kworker.0 Request processed in 32us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664257.329869:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788664257.329907:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200448 00000100:00100000:0.0:1788664257.329911:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200448 00000100:00100000:0.0:1788664257.329938:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788664257.329966:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222200448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.329998:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222200448:12345-0@lo:400:kworker.0 Request processed in 55us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664257.330004:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788664257.330019:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664257.330024:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664257.330052:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222199936:0@lo:400:kworker.0 00010000:00080000:0.0:1788664257.330066:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f2a300 x1875550222200448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664257.330078:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222200448:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.330086:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222199808:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.330096:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222200320:0@lo:400:kworker.0 00000100:00100000:0.0:1788664257.823714:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222200576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664257.823834:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664257.823975:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200576 00000100:00100000:0.0:1788664257.823986:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200576 00000100:00100000:0.0:1788664257.824082:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788664257.824094:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222200576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664257.824150:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664257.825023:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222200576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 924us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664257.825035:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788664257.825109:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c60d1500 x1875550222200576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664257.825133:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222200576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788664258.336459:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664259.367653:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664260.388595:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664260.898620:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664260.898652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222200704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664260.898759:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664260.898854:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200704 00000100:00100000:2.0:1788664260.898864:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200704 00000100:00100000:2.0:1788664260.898934:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664260.898945:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222200704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664260.898993:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664260.899045:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222200704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664260.899071:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788664260.899098:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664260.899140:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f19500 x1875550222200704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664260.899162:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222200704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664261.408498:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664261.561323:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664261.561391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664261.561403:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339200 00000100:00100000:0.0:1788664261.561415:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339200 00000100:00100000:0.0:1788664261.561477:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:0.0:1788664261.561489:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204339200:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664261.561558:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204339200:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664261.561566:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:0.0:1788664261.561598:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339328 00000100:00100000:0.0:1788664261.561601:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339328 00000100:00100000:0.0:1788664261.561639:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:0.0:1788664261.561646:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204339328:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664261.561685:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204339328:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 40us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664261.561692:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00080000:0.0:1788664261.561801:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664262.431813:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222200832:0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.431903:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664262.431956:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222201344:0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.431980:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664262.432005:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788664262.432009:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222200960:0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.432027:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664262.432039:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222201472:0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.432058:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664262.432085:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201344 00000100:00100000:0.0:1788664262.432092:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201344 00000100:00100000:0.0:1788664262.432138:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200960 00000100:00100000:0.0:1788664262.432140:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200960 00000100:00100000:0.0:1788664262.432156:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788664262.432163:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222201344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.432209:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222201344:12345-0@lo:400:kworker.0 Request processed in 46us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664262.432216:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788664262.432230:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664262.432235:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222200960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.432258:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222200960:12345-0@lo:400:kworker.0 Request processed in 22us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664262.432263:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788664262.432281:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664262.432322:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222200960:0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.432332:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222201344:0@lo:400:kworker.0 00000100:00100000:1.0:1788664262.432527:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222200832 00000100:00100000:1.0:1788664262.432532:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222200832 00000100:00100000:1.0:1788664262.432563:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788664262.432570:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222200832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664262.432604:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222200832:12345-0@lo:400:kworker.0 Request processed in 35us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664262.432610:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788664262.432634:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201472 00000100:00100000:1.0:1788664262.432647:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201472 00000100:00100000:1.0:1788664262.432677:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788664262.432682:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222201472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664262.432708:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222201472:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664262.432713:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788664262.432734:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664262.432864:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222201088:0@lo:400:kworker.0 00000100:00100000:3.0:1788664262.432892:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664262.432917:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664262.432923:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222201216:0@lo:400:kworker.0 00000100:00100000:3.0:1788664262.432942:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664262.432968:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201216 00000100:00100000:3.0:1788664262.432971:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201216 00000100:00100000:3.0:1788664262.432997:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788664262.433002:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222201216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664262.433030:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222201216:12345-0@lo:400:kworker.0 Request processed in 29us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664262.433036:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788664262.433061:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f2a680 x1875550222201216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664262.433072:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222201216:0@lo:400:kworker.0 00000100:00080000:1.0:1788664262.433194:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664262.433203:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201088 00000100:00100000:1.0:1788664262.433206:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201088 00000100:00100000:1.0:1788664262.433237:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664262.433242:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222201088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664262.433274:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222201088:12345-0@lo:400:kworker.0 Request processed in 32us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664262.433280:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788664262.433397:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664262.433415:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222201088:0@lo:400:kworker.0 00010000:00080000:0.0:1788664262.433505:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f29880 x1875550222201472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664262.433516:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222201472:0@lo:400:kworker.0 00000100:00100000:0.0:1788664262.433524:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222200832:0@lo:400:kworker.0 00010000:00010000:3.0:1788664262.434013:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664262.945173:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664262.945210:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222201600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664262.945301:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664262.945559:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201600 00000100:00100000:2.0:1788664262.945570:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201600 00000100:00100000:2.0:1788664262.945636:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664262.945648:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222201600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664262.945692:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664262.945751:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222201600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664262.945758:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788664262.945904:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1aa00 x1875550222201600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664262.945925:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222201600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788664263.455706:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788664263.763684:0:10132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:11:03 (1788664263) === 00000100:00100000:1.0:1788664264.111819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664264.111937:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339456 00000100:00100000:2.0:1788664264.111946:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339456 00000100:00100000:2.0:1788664264.112001:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 209 00000100:00100000:2.0:1788664264.112010:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:8145:x1875550204339456:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788664264.112026:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664264.112042:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512a400/0x762f55027be9020d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24367f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664264.112069:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512a400/0x762f55027be9020d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24367f expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664264.112093:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512a400/0x762f55027be9020d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24367f expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664264.112103:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512a400, rc 0) 00000100:00100000:2.0:1788664264.112164:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8145:x1875550204339456:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 155us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664264.112171:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 209 00000100:00100000:0.0:1788664264.115492:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664264.115651:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339584 00000100:00100000:2.0:1788664264.115660:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339584 00000100:00100000:2.0:1788664264.115709:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 210 00000100:00100000:2.0:1788664264.115718:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8145:x1875550204339584:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788664264.115991:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8145:x1875550204339584:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 273us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664264.115999:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 210 00000100:00100000:3.0:1788664264.119964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664264.120056:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339712 00000100:00100000:1.0:1788664264.120066:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339712 00000100:00100000:1.0:1788664264.120115:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00100000:1.0:1788664264.120124:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8145:x1875550204339712:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788664264.120336:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8145:x1875550204339712:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 212us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.120376:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00100000:1.0:1788664264.131495:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664264.132693:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339840 00000100:00100000:0.0:1788664264.132706:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339840 00000100:00100000:0.0:1788664264.132757:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 212 00000100:00100000:0.0:1788664264.132766:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8149:x1875550204339840:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664264.133050:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8149:x1875550204339840:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 283us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.133058:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 212 00000100:00100000:3.0:1788664264.147260:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664264.147402:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204339968 00000100:00100000:2.0:1788664264.147413:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204339968 00000100:00100000:2.0:1788664264.147465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:2.0:1788664264.147475:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8149:x1875550204339968:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664264.147746:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8149:x1875550204339968:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 271us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664264.147754:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:3.0:1788664264.149907:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664264.150194:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340096 00000100:00100000:1.0:1788664264.150201:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340096 00000100:00100000:1.0:1788664264.150251:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:1.0:1788664264.150261:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:8145:x1875550204340096:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788664264.150276:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664264.150295:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1479200/0x762f55027be90214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436a9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664264.150320:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479200/0x762f55027be90214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436a9 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664264.150372:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1479200/0x762f55027be90214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436a9 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664264.150384:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479200, rc 0) 00000100:00100000:1.0:1788664264.150433:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:8145:x1875550204340096:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 174us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.150440:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:1.0:1788664264.155202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664264.160491:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340224 00000100:00100000:0.0:1788664264.160507:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340224 00000100:00100000:0.0:1788664264.160565:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:0.0:1788664264.160575:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:8145:x1875550204340224:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788664264.160600:0:5848:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788664264.160622:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788664264.160626:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788664264.160630:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788664264.160632:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788664264.163495:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:8145:x1875550204340224:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 2910us (8290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.163516:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:3.0:1788664264.166568:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664264.166659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340352 00000100:00100000:2.0:1788664264.166667:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340352 00000100:00100000:2.0:1788664264.166717:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:2.0:1788664264.166727:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:8145:x1875550204340352:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788664264.166755:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664264.166771:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436b0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664264.166800:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664264.166812:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664264.166821:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b200, rc 0) 00000100:00100000:2.0:1788664264.166871:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8145:x1875550204340352:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 145us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664264.166878:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:1.0:1788664264.169848:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664264.169941:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340480 00000100:00100000:0.0:1788664264.169949:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340480 00000100:00100000:0.0:1788664264.169996:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:0.0:1788664264.170006:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8145:x1875550204340480:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788664264.170273:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8145:x1875550204340480:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 267us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.170280:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:3.0:1788664264.173317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664264.173439:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340608 00000100:00100000:1.0:1788664264.173450:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340608 00000100:00100000:1.0:1788664264.173502:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:1.0:1788664264.173511:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8145:x1875550204340608:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788664264.173731:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8145:x1875550204340608:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 220us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.173739:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:3.0:1788664264.180042:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664264.180248:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340736 00000100:00100000:2.0:1788664264.180259:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340736 00000100:00100000:2.0:1788664264.180320:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:2.0:1788664264.180330:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8153:x1875550204340736:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664264.180591:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8153:x1875550204340736:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 262us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664264.180600:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:2.0:1788664264.183203:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664264.183299:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340864 00000100:00100000:0.0:1788664264.183308:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340864 00000100:00100000:0.0:1788664264.183382:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:0.0:1788664264.183392:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8153:x1875550204340864:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664264.183601:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:8153:x1875550204340864:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 210us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.183610:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:3.0:1788664264.186433:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664264.186470:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664264.186688:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204341376 00000100:00100000:1.0:1788664264.186706:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204341376 00000100:00100000:1.0:1788664264.186767:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204340992 00000100:00100000:1.0:1788664264.186770:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204340992 00000100:00100000:1.0:1788664264.186792:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:1.0:1788664264.186802:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204341376:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664264.186878:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204341376:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 78us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.186887:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:1.0:1788664264.186915:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788664264.186931:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1875550204340992:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788664264.186953:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 907eac49-0e74-41b0-b01e-8a20532e4f07@192.168.202.14@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:1.0:1788664264.186984:0:5854:0:(genops.c:1385:class_connect()) connect: client 907eac49-0e74-41b0-b01e-8a20532e4f07, cookie 0x762f55027be90222 00000004:00100000:1.0:1788664264.187014:0:5854:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b6 00000100:00080000:1.0:1788664264.187256:0:5854:0:(import.c:65:import_set_state_nolock()) ffff9b68dfc6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664264.187286:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2357:x1875550204340992:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 354us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.187293:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00080000:3.0:1788664264.187660:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664264.196055:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664264.196102:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664264.196265:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204341120 00000100:00100000:0.0:1788664264.196275:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204341120 00000100:00100000:0.0:1788664264.196363:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204341248 00000100:00100000:0.0:1788664264.196366:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204341248 00000100:00100000:0.0:1788664264.196388:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788664264.196397:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+7:0:x1875550204341120:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788664264.196445:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788664264.196522:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+7:0:x1875550204341120:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 126us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.196529:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788664264.196558:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788664264.196564:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:8145:x1875550204341248:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788664264.196574:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788664264.196593:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:8145:x1875550204341248:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.196599:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00080000:3.0:1788664264.196958:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664264.202477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664264.202749:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204341504 00000100:00100000:0.0:1788664264.202760:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204341504 00000100:00100000:0.0:1788664264.202833:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788664264.202843:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:8145:x1875550204341504:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788664264.202936:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:8145:x1875550204341504:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 86us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.202944:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:3.0:1788664264.211397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664264.211433:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664264.211513:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204341632 00000100:00100000:1.0:1788664264.211522:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204341632 00000100:00100000:1.0:1788664264.211558:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204341760 00000100:00100000:1.0:1788664264.211561:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204341760 00000100:00100000:1.0:1788664264.211584:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:1.0:1788664264.211592:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875550204341632:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788664264.211623:0:8476:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 907eac49-0e74-41b0-b01e-8a20532e4f07@192.168.202.14@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:1.0:1788664264.211653:0:8476:0:(genops.c:1385:class_connect()) connect: client 907eac49-0e74-41b0-b01e-8a20532e4f07, cookie 0x762f55027be90229 00002000:00100000:1.0:1788664264.211664:0:8476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 907eac49-0e74-41b0-b01e-8a20532e4f07/ffff9b68dfc6b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788664264.211702:0:8476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b6 00002000:00080000:1.0:1788664264.211919:0:8476:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788664264.211972:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9b68dfc6a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664264.212033:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2357:x1875550204341632:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 441us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.212041:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:1.0:1788664264.212069:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:1.0:1788664264.212073:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875550204341760:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788664264.212790:0:8476:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 907eac49-0e74-41b0-b01e-8a20532e4f07@192.168.202.14@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:1.0:1788664264.212813:0:8476:0:(genops.c:1385:class_connect()) connect: client 907eac49-0e74-41b0-b01e-8a20532e4f07, cookie 0x762f55027be90230 00002000:00100000:1.0:1788664264.212821:0:8476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 907eac49-0e74-41b0-b01e-8a20532e4f07/ffff9b68dfc6d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788664264.212837:0:8476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b6 00002000:00080000:1.0:1788664264.212978:0:8476:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788664264.212997:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9b68dfc68800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664264.213026:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2357:x1875550204341760:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 951us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664264.213034:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788664264.221391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664264.221590:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204341888 00000100:00100000:0.0:1788664264.221599:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204341888 00000100:00100000:0.0:1788664264.221656:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:0.0:1788664264.221665:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+6:8145:x1875550204341888:12345-192.168.202.14@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788664264.221764:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788664264.221859:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+6:8145:x1875550204341888:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 195us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664264.221867:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00010000:00010000:2.0:1788664264.480078:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664265.512392:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788664265.546686:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 907eac49-0e74-41b0-b01e-8a20532e4f07 00000100:00100000:1.0:1788664266.017321:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664266.017367:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222201728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664266.017437:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664266.017512:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201728 00000100:00100000:1.0:1788664266.017520:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201728 00000100:00100000:1.0:1788664266.017573:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788664266.017583:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222201728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664266.017607:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664266.017651:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222201728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664266.017670:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788664266.017692:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788664266.017721:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f29880 x1875550222201728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664266.017742:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222201728:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788664266.099151:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 907eac49-0e74-41b0-b01e-8a20532e4f07 00010000:00010000:2.0:1788664266.528125:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664267.554533:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664267.554848:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222201984:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.554937:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664267.554988:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222202496:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555016:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664267.555047:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664267.555054:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222201856:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555084:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664267.555107:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222202368:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555131:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664267.555335:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222202112:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555411:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664267.555433:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664267.555439:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222202240:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664267.555496:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201984 00000100:00100000:2.0:1788664267.555503:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201984 00000100:00100000:2.0:1788664267.555545:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222202368 00000100:00100000:2.0:1788664267.555549:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222202368 00000100:00100000:2.0:1788664267.555572:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222202112 00000100:00100000:2.0:1788664267.555576:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222202112 00000100:00100000:2.0:1788664267.555593:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664267.555601:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222201984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555655:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222201984:12345-0@lo:400:kworker.0 Request processed in 53us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664267.555662:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664267.555680:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664267.555687:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222202368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555725:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222202368:12345-0@lo:400:kworker.0 Request processed in 39us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664267.555732:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664267.555743:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664267.555750:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222202112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.555781:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222202112:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664267.555787:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664267.555807:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222202496 00000100:00100000:2.0:1788664267.555811:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222202496 00000100:00100000:2.0:1788664267.557429:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222202240 00000100:00100000:2.0:1788664267.557441:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222202240 00000100:00100000:1.0:1788664267.559978:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664267.559998:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222202496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664267.560089:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222202496:12345-0@lo:400:kworker.0 Request processed in 99us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664267.560096:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664267.560120:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664267.560127:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222202240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664267.560156:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222202240:12345-0@lo:400:kworker.0 Request processed in 30us (4692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664267.560173:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664267.561515:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222201856 00000100:00100000:1.0:1788664267.561528:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222201856 00000100:00100000:1.0:1788664267.561580:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788664267.561589:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222201856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664267.561648:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222201856:12345-0@lo:400:kworker.0 Request processed in 61us (6563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664267.561656:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:2.0:1788664267.562329:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664267.562335:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664267.564268:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222201856:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.564308:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222202368:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.564321:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222201984:0@lo:400:kworker.0 00010000:00080000:2.0:1788664267.564337:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1fb80 x1875550222202496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664267.564372:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222202496:0@lo:400:kworker.0 00010000:00080000:2.0:1788664267.564447:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c612ed80 x1875550222202240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664267.564457:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222202240:0@lo:400:kworker.0 00000100:00100000:2.0:1788664267.564469:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222202112:0@lo:400:kworker.0 00000100:00100000:3.0:1788664268.064854:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222202624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664268.064948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664268.065307:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222202624 00000100:00100000:1.0:1788664268.065315:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222202624 00000100:00100000:1.0:1788664268.065409:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788664268.065421:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222202624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664268.065460:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664268.065512:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222202624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664268.065536:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788664268.065582:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f80ddf80 x1875550222202624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664268.065601:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222202624:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788664268.136101:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 907eac49-0e74-41b0-b01e-8a20532e4f07 00010000:00010000:0.0:1788664268.577525:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664269.240732:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664269.240786:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664269.240826:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664269.240875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664269.240904:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664269.240932:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342272 00000100:00100000:0.0:1788664269.240942:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342272 00000100:00100000:0.0:1788664269.240997:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342144 00000100:00100000:0.0:1788664269.241000:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342144 00000100:00100000:0.0:1788664269.241023:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:0.0:1788664269.241034:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204342272:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664269.241128:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204342272:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 96us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664269.241136:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:0.0:1788664269.241153:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:0.0:1788664269.241160:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204342144:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664269.241182:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204342144:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 24us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664269.241188:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:0.0:1788664269.241207:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342528 00000100:00100000:0.0:1788664269.241210:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342528 00000100:00100000:0.0:1788664269.241232:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342400 00000100:00100000:0.0:1788664269.241234:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342400 00000100:00100000:0.0:1788664269.241253:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:0.0:1788664269.241259:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204342528:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664269.241297:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204342528:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 38us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664269.241304:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:0.0:1788664269.241315:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:0.0:1788664269.241328:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dffa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204342400:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664269.241385:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dffa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204342400:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 57us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664269.241391:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00080000:0.0:1788664269.241549:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664269.241554:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664269.241556:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664269.242958:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342016 00000100:00100000:2.0:1788664269.242970:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342016 00000100:00100000:2.0:1788664269.243040:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 222 00000100:00100000:2.0:1788664269.243049:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204342016:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664269.243109:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204342016:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 61us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664269.243115:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 222 00010000:00010000:2.0:1788664269.599566:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788664270.267184:0:10328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788664270.623985:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664271.135711:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222202752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664271.135788:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664271.136033:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222202752 00000100:00100000:1.0:1788664271.136042:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222202752 00000100:00100000:1.0:1788664271.136111:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788664271.136120:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222202752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664271.136165:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664271.136210:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222202752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664271.136218:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788664271.136302:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f29880 x1875550222202752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664271.136323:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222202752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664271.136858:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664271.648896:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664272.672084:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664272.673185:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222202880:0@lo:400:kworker.0 00000100:00100000:0.0:1788664272.673260:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664272.673424:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222202880 00000100:00100000:2.0:1788664272.673432:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222202880 00000100:00100000:2.0:1788664272.673482:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788664272.673491:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222202880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664272.677572:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222202880:12345-0@lo:400:kworker.0 Request processed in 4070us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664272.677587:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788664272.677990:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222203008:0@lo:400:kworker.0 00000100:00100000:2.0:1788664272.678571:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222203136:0@lo:400:kworker.0 00000100:00100000:2.0:1788664272.678632:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664272.678666:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664272.678673:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222203264:0@lo:400:kworker.0 00000100:00100000:2.0:1788664272.678713:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664272.678747:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203136 00000100:00100000:2.0:1788664272.678755:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203136 00000100:00100000:2.0:1788664272.678809:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788664272.678818:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222203136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664272.678866:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222203136:12345-0@lo:400:kworker.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664272.678872:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788664272.678893:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203264 00000100:00100000:2.0:1788664272.678896:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203264 00000100:00100000:2.0:1788664272.678918:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664272.678925:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222203264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664272.678952:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222203264:12345-0@lo:400:kworker.0 Request processed in 28us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664272.678958:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788664272.678972:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788664272.679077:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f28700 x1875550222203264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664272.679092:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222203264:0@lo:400:kworker.0 00000100:00100000:2.0:1788664272.679106:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222203136:0@lo:400:kworker.0 00000100:00100000:1.0:1788664272.679215:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664272.679245:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222203520:0@lo:400:kworker.0 00000100:00100000:1.0:1788664272.679269:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664272.679291:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664272.679297:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222203392:0@lo:400:kworker.0 00000100:00100000:1.0:1788664272.679332:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664272.679381:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203520 00000100:00100000:1.0:1788664272.679386:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203520 00000100:00100000:1.0:1788664272.679420:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664272.679428:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222203520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664272.679472:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222203520:12345-0@lo:400:kworker.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664272.679478:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664272.679497:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203008 00000100:00100000:1.0:1788664272.679500:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203008 00000100:00100000:1.0:1788664272.679516:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203392 00000100:00100000:1.0:1788664272.679519:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203392 00000100:00100000:1.0:1788664272.679535:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788664272.679541:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222203008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664272.679569:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222203008:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664272.679575:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788664272.679586:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788664272.679591:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222203392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664272.679617:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222203392:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664272.679623:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788664272.679668:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222203392:0@lo:400:kworker.0 00000100:00100000:1.0:1788664272.679677:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222203008:0@lo:400:kworker.0 00010000:00080000:1.0:1788664272.679686:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f2a300 x1875550222203520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664272.679695:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222203520:0@lo:400:kworker.0 00000100:00080000:2.0:1788664272.680654:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664272.680661:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664272.683232:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222202880:0@lo:400:kworker.0 00000100:00100000:2.0:1788664273.186576:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222203648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664273.186661:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664273.191647:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203648 00000100:00100000:1.0:1788664273.191664:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203648 00000100:00100000:0.0:1788664273.192631:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788664273.192654:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222203648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664273.192699:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664273.192793:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222203648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (6131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664273.192800:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788664273.192863:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f80dfb80 x1875550222203648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664273.192885:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222203648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788664273.701409:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664274.364845:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664274.364899:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664274.364918:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664274.364934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664274.364953:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664274.364982:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343168 00000100:00100000:3.0:1788664274.364991:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343168 00000100:00100000:3.0:1788664274.365042:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343040 00000100:00100000:3.0:1788664274.365044:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343040 00000100:00100000:3.0:1788664274.365061:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:3.0:1788664274.365070:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204343168:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664274.365141:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204343168:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664274.365148:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:3.0:1788664274.365164:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788664274.365169:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204343040:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664274.365188:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204343040:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 19us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664274.365193:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788664274.365210:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342912 00000100:00100000:3.0:1788664274.365212:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342912 00000100:00100000:3.0:1788664274.365234:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342784 00000100:00100000:3.0:1788664274.365236:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342784 00000100:00100000:3.0:1788664274.365250:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:3.0:1788664274.365256:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204342912:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664274.365277:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204342912:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 21us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664274.365290:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:3.0:1788664274.365300:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788664274.365305:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2359:x1875550204342784:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664274.365323:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2359:x1875550204342784:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 17us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664274.365328:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00080000:3.0:1788664274.365376:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664274.365381:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664274.365383:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664274.368861:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204342656 00000100:00100000:1.0:1788664274.368885:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204342656 00000100:00100000:1.0:1788664274.368940:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 224 00000100:00100000:1.0:1788664274.368949:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204342656:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664274.369012:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204342656:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 66us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664274.369017:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 224 00010000:00010000:0.0:1788664274.720046:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664275.743664:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664276.257171:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222203776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664276.257258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664276.259451:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203776 00000100:00100000:3.0:1788664276.259465:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203776 00000100:00100000:3.0:1788664276.259547:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788664276.259558:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222203776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664276.259595:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788664276.259977:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664276.271396:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222203776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11830us (14128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664276.271412:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788664276.273269:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f2a300 x1875550222203776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664276.273304:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222203776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788664276.772995:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664277.792208:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222204160:0@lo:400:kworker.0 00000100:00100000:1.0:1788664277.792280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664277.792333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664277.792360:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222204288:0@lo:400:kworker.0 00000100:00100000:1.0:1788664277.792387:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664277.792425:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204160 00000100:00100000:1.0:1788664277.792433:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204160 00000100:00100000:1.0:1788664277.792485:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788664277.792494:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222204160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664277.792544:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222204160:12345-0@lo:400:kworker.0 Request processed in 50us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664277.792551:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788664277.792574:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204288 00000100:00100000:1.0:1788664277.792578:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204288 00000100:00100000:1.0:1788664277.792603:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788664277.792609:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222204288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664277.792640:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222204288:12345-0@lo:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664277.792646:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788664277.792673:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664277.792706:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f29c00 x1875550222204288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664277.792722:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222204288:0@lo:400:kworker.0 00000100:00100000:1.0:1788664277.792733:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222204160:0@lo:400:kworker.0 00000100:00100000:0.0:1788664277.792870:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222203904:0@lo:400:kworker.0 00000100:00100000:0.0:1788664277.792911:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664277.792941:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222204416:0@lo:400:kworker.0 00000100:00100000:0.0:1788664277.792963:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664277.792979:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788664277.792983:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222204032:0@lo:400:kworker.0 00000100:00100000:0.0:1788664277.793003:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664277.793014:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222204544:0@lo:400:kworker.0 00000100:00100000:0.0:1788664277.793030:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664277.793104:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204416 00000100:00100000:3.0:1788664277.793109:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204416 00000100:00100000:3.0:1788664277.793144:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204032 00000100:00100000:3.0:1788664277.793147:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204032 00000100:00100000:3.0:1788664277.793159:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788664277.793166:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222204416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664277.793205:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222204416:12345-0@lo:400:kworker.0 Request processed in 40us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664277.793211:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788664277.793232:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788664277.793237:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222204032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664277.793280:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222204032:12345-0@lo:400:kworker.0 Request processed in 43us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664277.793286:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788664277.793315:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222204032:0@lo:400:kworker.0 00000100:00100000:3.0:1788664277.793324:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222204416:0@lo:400:kworker.0 00000100:00080000:0.0:1788664277.793515:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664277.793633:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222203904 00000100:00100000:1.0:1788664277.793637:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222203904 00000100:00100000:1.0:1788664277.793673:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788664277.793680:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222203904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664277.793721:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222203904:12345-0@lo:400:kworker.0 Request processed in 42us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664277.793727:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788664277.793756:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204544 00000100:00100000:1.0:1788664277.793760:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204544 00000100:00100000:1.0:1788664277.793788:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788664277.793794:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222204544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664277.793823:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222204544:12345-0@lo:400:kworker.0 Request processed in 30us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664277.793828:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788664277.793917:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788664277.794216:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c5f2b480 x1875550222204544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664277.794227:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222204544:0@lo:400:kworker.0 00000100:00100000:3.0:1788664277.794236:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222203904:0@lo:400:kworker.0 00010000:00010000:0.0:1788664277.807670:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664278.303893:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222204672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664278.303974:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664278.304064:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204672 00000100:00100000:0.0:1788664278.304073:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204672 00000100:00100000:0.0:1788664278.304136:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788664278.304146:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222204672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664278.304188:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664278.304245:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222204672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664278.304254:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788664278.304298:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c60d3800 x1875550222204672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664278.304319:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222204672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788664278.817617:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664279.480626:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664279.480724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664279.480757:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664279.480816:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664279.480849:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664279.480879:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343552 00000100:00100000:3.0:1788664279.480889:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343552 00000100:00100000:3.0:1788664279.480960:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343424 00000100:00100000:3.0:1788664279.480964:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343424 00000100:00100000:3.0:1788664279.480997:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:3.0:1788664279.481008:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204343552:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664279.481107:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204343552:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 101us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664279.481115:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:3.0:1788664279.481138:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:3.0:1788664279.481144:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204343424:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664279.481169:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204343424:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664279.481175:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00080000:3.0:1788664279.481191:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664279.483826:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343808 00000100:00100000:1.0:1788664279.483844:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343808 00000100:00100000:1.0:1788664279.483917:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343680 00000100:00100000:1.0:1788664279.483921:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343680 00000100:00100000:1.0:1788664279.483950:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:1.0:1788664279.483960:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204343808:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664279.484268:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204343808:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 307us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664279.484292:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:1.0:1788664279.484309:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788664279.484315:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204343680:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664279.484377:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204343680:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 61us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664279.484385:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00080000:3.0:1788664279.484848:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664279.484853:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664279.485262:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343296 00000100:00100000:2.0:1788664279.485270:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343296 00000100:00100000:2.0:1788664279.485322:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 226 00000100:00100000:2.0:1788664279.485331:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2360:x1875550204343296:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664279.485597:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2360:x1875550204343296:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 266us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664279.485606:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 226 00010000:00010000:3.0:1788664279.847529:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664280.863690:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664281.380371:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664281.385438:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222204800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664281.385522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664281.386532:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204800 00000100:00100000:1.0:1788664281.386544:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204800 00000100:00100000:1.0:1788664281.386625:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788664281.386637:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222204800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664281.386654:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788664281.386676:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664281.386753:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222204800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664281.386762:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788664281.387103:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8b6b480 x1875550222204800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664281.387124:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8b6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222204800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788664281.895140:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664282.912263:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222205312:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.912336:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222204928:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.912402:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664282.912453:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222205440:0@lo:400:kworker.0 00000100:00100000:2.0:1788664282.912481:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664282.912487:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664282.912583:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664282.914035:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788664282.914050:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222205056:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.914092:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664282.914178:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222205568:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.914203:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664282.914260:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222205184:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.914288:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664282.918011:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205312 00000100:00100000:1.0:1788664282.918027:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205312 00000100:00100000:1.0:1788664282.918093:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205568 00000100:00100000:1.0:1788664282.918098:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205568 00000100:00100000:1.0:1788664282.918326:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664282.918337:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222205312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664282.918589:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222205312:12345-0@lo:400:kworker.0 Request processed in 253us (6107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664282.918597:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664282.918615:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664282.918622:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222205568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664282.918668:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222205568:12345-0@lo:400:kworker.0 Request processed in 47us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664282.918675:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788664282.919416:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788664282.920710:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1c000 x1875550222205312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664282.920731:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222205312:0@lo:400:kworker.0 00000100:00100000:0.0:1788664282.921019:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205440 00000100:00100000:0.0:1788664282.921028:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205440 00000100:00100000:0.0:1788664282.921093:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205056 00000100:00100000:0.0:1788664282.921097:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205056 00000100:00100000:0.0:1788664282.921114:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205184 00000100:00100000:0.0:1788664282.921117:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205184 00000100:00100000:0.0:1788664282.921134:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788664282.921143:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222205440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664282.921215:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222205440:12345-0@lo:400:kworker.0 Request processed in 73us (8731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664282.921222:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788664282.921238:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788664282.921244:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222205056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664282.921374:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222205056:12345-0@lo:400:kworker.0 Request processed in 128us (7280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664282.921382:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788664282.921396:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788664282.921403:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222205184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664282.921431:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222205184:12345-0@lo:400:kworker.0 Request processed in 29us (7143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664282.921437:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788664282.921848:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222204928 00000100:00100000:1.0:1788664282.921864:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222204928 00000100:00100000:1.0:1788664282.921891:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788664282.921896:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222204928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664282.921926:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222204928:12345-0@lo:400:kworker.0 Request processed in 31us (9526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664282.921930:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1788664282.922432:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664282.922488:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222205056:0@lo:400:kworker.0 00010000:00080000:3.0:1788664282.922504:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1ca80 x1875550222205568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664282.922515:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222205568:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.922525:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222204928:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.922534:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222205440:0@lo:400:kworker.0 00000100:00100000:3.0:1788664282.923237:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222205184:0@lo:400:kworker.0 00000100:00100000:2.0:1788664283.424895:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664283.424919:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222205696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664283.425003:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664283.425051:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205696 00000100:00100000:0.0:1788664283.425060:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205696 00000100:00100000:0.0:1788664283.425268:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788664283.425280:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222205696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664283.425319:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664283.425389:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222205696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664283.425407:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788664283.425411:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8b6bb80 x1875550222205696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664283.425434:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8b6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222205696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664283.942671:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664284.599386:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664284.599423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664284.599449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664284.599477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204343936 00000100:00100000:3.0:1788664284.599487:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204343936 00000100:00100000:3.0:1788664284.599539:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 228 00000100:00100000:3.0:1788664284.599550:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204343936:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664284.599621:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204343936:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664284.599628:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 228 00000100:00100000:3.0:1788664284.599662:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344192 00000100:00100000:3.0:1788664284.599666:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344192 00000100:00100000:3.0:1788664284.599733:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344064 00000100:00100000:3.0:1788664284.599737:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344064 00000100:00100000:3.0:1788664284.599758:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788664284.599765:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2361:x1875550204344192:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664284.599814:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2361:x1875550204344192:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 49us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664284.599821:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788664284.599833:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:3.0:1788664284.599838:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204344064:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664284.599861:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204344064:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664284.599866:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00080000:3.0:1788664284.600034:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664284.604264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664284.604304:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664284.604363:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344320 00000100:00100000:2.0:1788664284.604373:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344320 00000100:00100000:2.0:1788664284.604429:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344448 00000100:00100000:2.0:1788664284.604433:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344448 00000100:00100000:2.0:1788664284.604455:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788664284.604464:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2357:x1875550204344320:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:2.0:1788664284.604495:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90229 00000100:00080000:2.0:1788664284.604503:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b68dfc6a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664284.604540:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788664284.605431:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+2:2357:x1875550204344320:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 964us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664284.605441:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788664284.605461:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788664284.605470:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2357:x1875550204344448:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:2.0:1788664284.605485:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90230 00000100:00080000:2.0:1788664284.605491:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b68dfc68800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664284.605515:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788664284.605876:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+2:2357:x1875550204344448:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 406us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664284.605884:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00080000:2.0:1788664284.606035:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664284.606208:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788664284.606228:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664284.607688:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664284.959551:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664285.996764:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664286.497550:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664286.497574:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222205824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664286.497651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664286.497823:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205824 00000100:00100000:2.0:1788664286.497831:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205824 00000100:00100000:2.0:1788664286.497890:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788664286.497900:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222205824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664286.497946:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664286.497990:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222205824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664286.497998:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788664286.498801:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664286.498909:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8b69180 x1875550222205824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664286.498930:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222205824:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788664286.541324:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 907eac49-0e74-41b0-b01e-8a20532e4f07 00000020:00000080:0.0:1788664286.541333:0:7657:0:(genops.c:885:class_export_put()) final put ffff9b68dfc6d000/907eac49-0e74-41b0-b01e-8a20532e4f07 00000020:00000080:2.0:1788664286.541616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68dfc6d000/907eac49-0e74-41b0-b01e-8a20532e4f07 for lustre-OST0001 00000020:00000080:2.0:1788664286.541672:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68dfc68800 for lustre-OST0001 00010000:00010000:2.0:1788664287.007450:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664287.289840:0:11028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788664288.031702:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664288.035052:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664288.035074:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222206208:0@lo:400:kworker.0 00000100:00100000:0.0:1788664288.035145:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664288.035224:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222206080:0@lo:400:kworker.0 00000100:00100000:0.0:1788664288.035226:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222206336:0@lo:400:kworker.0 00000100:00100000:0.0:1788664288.035264:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664288.035272:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664288.035324:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222205952:0@lo:400:kworker.0 00000100:00100000:0.0:1788664288.035447:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222206336 00000100:00100000:0.0:1788664288.035456:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222206336 00000100:00100000:0.0:1788664288.035526:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788664288.035536:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222206336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664288.035846:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222206208 00000100:00100000:2.0:1788664288.035851:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222206208 00000100:00100000:2.0:1788664288.035880:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222206080 00000100:00100000:2.0:1788664288.035883:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222206080 00000100:00100000:2.0:1788664288.035900:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788664288.035907:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222206208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664288.039768:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222206592:0@lo:400:kworker.0 00000100:00100000:1.0:1788664288.039768:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664288.039828:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222206464:0@lo:400:kworker.0 00000100:00100000:3.0:1788664288.039838:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664288.039867:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664288.039893:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222206464 00000100:00100000:3.0:1788664288.039902:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222206464 00000100:00100000:1.0:1788664288.039903:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222205952 00000100:00100000:1.0:1788664288.039908:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222205952 00000100:00100000:3.0:1788664288.039944:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788664288.039953:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788664288.039954:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222206080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664288.039968:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222205952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664288.040014:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222206080:12345-0@lo:400:kworker.0 Request processed in 64us (4744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664288.040022:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788664288.040029:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222205952:12345-0@lo:400:kworker.0 Request processed in 63us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664288.040038:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788664288.040042:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788664288.040049:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222206464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664288.040080:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222206464:12345-0@lo:400:kworker.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664288.040087:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788664288.040105:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222206464:0@lo:400:kworker.0 00000100:00080000:3.0:1788664288.040107:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664288.040115:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664288.040121:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222205952:0@lo:400:kworker.0 00000100:00100000:3.0:1788664288.040134:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222206592 00000100:00100000:3.0:1788664288.040140:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222206592 00000100:00100000:3.0:1788664288.040168:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664288.040172:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222206592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664288.040208:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222206592:12345-0@lo:400:kworker.0 Request processed in 26us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664288.040213:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788664288.040227:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788664288.040244:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8935f80 x1875550222206592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664288.040253:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222206592:0@lo:400:kworker.0 00000100:00100000:3.0:1788664288.040277:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222206080:0@lo:400:kworker.0 00000100:00100000:0.0:1788664288.040446:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222206336:12345-0@lo:400:kworker.0 Request processed in 4910us (5180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664288.040455:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788664288.043402:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c60d0a80 x1875550222206336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664288.043421:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222206336:0@lo:400:kworker.0 00000100:00100000:2.0:1788664288.050252:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222206208:12345-0@lo:400:kworker.0 Request processed in 14335us (15097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664288.050267:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788664288.050339:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222206208:0@lo:400:kworker.0 00000100:00100000:2.0:1788664288.543776:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664288.549536:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222206720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664288.549614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664288.549717:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222206720 00000100:00100000:2.0:1788664288.549725:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222206720 00000100:00100000:2.0:1788664288.549774:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664288.549784:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222206720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664288.549824:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664288.549868:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222206720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664288.549886:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788664288.549931:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8b6b100 x1875550222206720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664288.549952:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8b6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222206720:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788664288.644180:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 907eac49-0e74-41b0-b01e-8a20532e4f07 00000020:00000080:1.0:1788664288.644251:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b68dfc6b000/907eac49-0e74-41b0-b01e-8a20532e4f07 00000020:00000080:1.0:1788664288.644287:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68dfc6b000/907eac49-0e74-41b0-b01e-8a20532e4f07 for lustre-OST0000 00000020:00000080:1.0:1788664288.644357:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68dfc6a000 for lustre-OST0000 00010000:00010000:0.0:1788664289.055634:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664289.718568:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664289.718615:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664289.718642:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664289.718671:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344704 00000100:00100000:0.0:1788664289.718843:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344832 00000100:00100000:0.0:1788664289.718847:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344832 00000100:00100000:0.0:1788664289.718913:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:0.0:1788664289.718925:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204344832:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664289.719017:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204344832:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 95us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664289.719025:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:3.0:1788664289.719390:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344704 00000100:00100000:3.0:1788664289.719423:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:3.0:1788664289.719431:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2359:x1875550204344704:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664289.719468:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2359:x1875550204344704:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 37us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664289.719475:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00080000:3.0:1788664289.719493:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664289.722295:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344576 00000100:00100000:2.0:1788664289.722309:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344576 00000100:00100000:2.0:1788664289.722385:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 230 00000100:00100000:2.0:1788664289.722395:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204344576:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664289.722481:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204344576:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 87us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664289.722488:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 230 00010000:00010000:2.0:1788664290.079487:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788664290.846801:0:11177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff28356330 20000000:00000080:3.0:1788664290.846821:0:11177:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b68f892f800 uarg=0000000000000000 20000000:01000000:3.0:1788664290.846857:0:11177:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788664290.846863:0:11177:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788664290.846869:0:11177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788664290.852889:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788664290.853043:0:11177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788664290.856433:0:11177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788664290.856465:0:11177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856485:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856494:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901e3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856501:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901f1 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856508:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be901ff expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856514:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856521:0:11177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856565:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856581:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 12 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.856614:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222206848:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664290.856726:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be901ff expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.856734:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be901ff expref: 18 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.856743:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222206976:0@lo:104: 00000100:00100000:1.0:1788664290.863665:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664290.863761:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be901f1 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.863778:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be901f1 expref: 18 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.863803:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222207104:0@lo:104: 00000100:00100000:0.0:1788664290.863809:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222206976 00000100:00100000:0.0:1788664290.863817:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222206976 00000100:00100000:1.0:1788664290.863845:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664290.863864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222207104 00000100:00100000:0.0:1788664290.863867:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222207104 00010000:00010000:1.0:1788664290.863872:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be901e3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664290.863880:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788664290.863881:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be901e3 expref: 18 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664290.863888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:11177:x1875550222206976:12345-0@lo:104: 00000100:00100000:1.0:1788664290.863889:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222207232:0@lo:104: 00010000:00010000:0.0:1788664290.863901:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.863908:0:11177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664290.863924:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.863944:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 12 pid: 5848 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.863955:0:11177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222207360:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664290.863965:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664290.863970:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:11177:x1875550222206976:12345-0@lo:104: Request processed in 84us (7191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664290.863977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664290.863992:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222207232 00000100:00100000:1.0:1788664290.863995:0:11177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664290.863995:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222207232 00000100:00100000:0.0:1788664290.864006:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788664290.864011:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:11177:x1875550222207104:12345-0@lo:104: 00000100:00100000:1.0:1788664290.864015:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222206848:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664290.864018:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.864023:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222206976:0@lo:104: 00010000:00010000:0.0:1788664290.864055:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788664290.864057:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788664290.864060:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:11177:x1875550222207104:12345-0@lo:104: Request processed in 49us (214us total) trans 0 rc 0/0 00010000:00010000:1.0:1788664290.864063:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664290.864065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788664290.864071:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147ac00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664290.864075:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664290.864076:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788664290.864081:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:11177:x1875550222207232:12345-0@lo:104: 00010000:00010000:1.0:1788664290.864084:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864088:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664290.864091:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664290.864097:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664290.864115:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788664290.864123:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664290.864124:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:11177:x1875550222207232:12345-0@lo:104: Request processed in 42us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1788664290.864130:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788664290.864131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788664290.864144:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664290.864148:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864155:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664290.864158:0:5843:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.864159:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864165:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664290.864172:0:5843:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.864176:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c147ac00/0x762f55027be901ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90206 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664290.864178:0:5843:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664290.864191:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.864193:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664290.864196:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864197:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664290.864201:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664290.864204:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.864211:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864212:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664290.864218:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864219:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be901f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be901f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664290.864224:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664290.864228:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664290.864229:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664290.864230:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664290.864242:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788664290.864246:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.864251:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664290.864256:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664290.864257:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222207488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664290.864263:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c147b000/0x762f55027be901e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be901ea expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.864275:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664290.864283:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664290.864292:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664290.864294:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664290.864306:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222207616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664290.864322:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222207104:0@lo:104: 00000100:00100000:0.0:1788664290.864326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664290.864329:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222207232:0@lo:104: 00000100:00100000:0.0:1788664290.864359:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788664290.864365:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222207744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664290.864385:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664290.864398:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222207488 00000100:00100000:1.0:1788664290.864402:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222207488 00000100:00100000:0.0:1788664290.864405:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222207616 00000100:00100000:0.0:1788664290.864407:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222207616 00010000:00010000:1.0:1788664290.864420:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be901ff expref: 20 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864420:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be901f1 expref: 20 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.864438:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222207744 00000100:00100000:1.0:1788664290.864441:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222207744 00010000:00010000:1.0:1788664290.864450:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be901e3 expref: 21 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664290.864570:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788664290.864577:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+21:3307:x1875550222207488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664290.864587:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664290.864592:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be901ff expref: 21 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864600:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be901ff expref: 21 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864612:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b800/0x762f55027be90206 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be901ff expref: 21 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864624:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664290.864649:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+20:3307:x1875550222207488:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664290.864654:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788664290.864672:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788664290.864679:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664290.864690:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222207616:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664290.864695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788664290.864698:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788664290.864702:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222207744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664290.864708:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664290.864713:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be901e3 expref: 19 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664290.864721:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be901e3 expref: 19 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664290.864730:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1478200/0x762f55027be901ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be901e3 expref: 19 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664290.864739:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664290.864774:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:3309:x1875550222207744:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664290.864792:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664290.864817:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222207744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664290.864820:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be901f1 expref: 19 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864828:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be901f1 expref: 17 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864838:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b400/0x762f55027be901f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be901f1 expref: 17 pid: 5849 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664290.864846:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664290.864961:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222207488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664290.865029:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664290.865052:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204344960 00000100:00100000:3.0:1788664290.865057:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204344960 00010000:00010000:3.0:1788664290.865074:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 13 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664290.865102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:3.0:1788664290.865110:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5891050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204344960:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664290.865118:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664290.865122:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 13 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664290.865131:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 13 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664290.865142:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512b200/0x762f55027be9021b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436b0 expref: 13 pid: 5847 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664290.865151:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664290.865173:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5891050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:2361:x1875550204344960:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 64us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664290.865179:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:0.0:1788664290.865265:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3309:x1875550222207616:12345-0@lo:103:ldlm_bl.0 Request processed in 574us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664290.865271:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664290.867090:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222207616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664290.872869:0:11177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1875550222207360:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664290.872917:0:11177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664290.873213:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664290.873385:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345088 00000100:00100000:1.0:1788664290.873395:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345088 00010000:00010000:1.0:1788664290.873440:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 12 pid: 5848 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664290.873478:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:1.0:1788664290.873490:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:2360:x1875550204345088:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664290.873508:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664290.873514:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 12 pid: 5848 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873545:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 12 pid: 5848 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873564:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512b400/0x762f55027be901dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243678 expref: 12 pid: 5848 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873580:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873588:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873604:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873611:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873618:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873623:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873629:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664290.873634:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873642:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873679:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664290.873691:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664290.873757:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:2360:x1875550204345088:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 269us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664290.873765:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00010000:00010000:3.0:1788664290.873839:0:11177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664290.873847:0:11177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664290.873854:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479600/0x762f55027be90237 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664291.103595:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664291.616124:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664291.616152:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222207872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664291.616238:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664291.616382:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222207872 00000100:00100000:1.0:1788664291.616399:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222207872 00000100:00100000:1.0:1788664291.616457:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664291.616468:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222207872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664291.616503:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664291.616548:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222207872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664291.616556:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788664291.616914:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788664291.616955:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8cdca80 x1875550222207872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664291.616977:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222207872:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788664292.133470:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664292.133478:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68c343c800 from 7 10000000:01000000:1.0:1788664292.133484:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664292.133532:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.133544:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.133556:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664292.133584:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.133673:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664292.133722:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664292.134126:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208000 00000100:00100000:0.0:1788664292.134136:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208000 00000100:00100000:0.0:1788664292.134201:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788664292.134211:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222208000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664292.134227:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664292.134245:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9023e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664292.134270:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9023e expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664292.134281:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9023e expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664292.134303:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee200, rc 0) 00000100:00100000:0.0:1788664292.134363:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222208000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664292.134370:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788664292.134459:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664292.134475:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.134485:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664292.134543:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.134573:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664292.134659:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43900 going to sleep for 11 seconds 00010000:00010000:0.0:1788664292.135231:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664292.137572:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208128 00000100:00100000:2.0:1788664292.137586:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208128 00000100:00100000:2.0:1788664292.137642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788664292.137652:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222208128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.137995:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222208128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664292.138003:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788664292.140589:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.140659:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.140728:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664292.140772:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664292.144225:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208256 00000100:00100000:2.0:1788664292.144240:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208256 00000100:00100000:2.0:1788664292.144294:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788664292.144303:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222208256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.144570:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222208256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664292.144579:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788664292.145001:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788664292.147912:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788664292.148072:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788664292.148170:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664292.148184:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.148198:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664292.148210:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664292.148228:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68f8b62000 from 7 10000000:01000000:1.0:1788664292.148232:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664292.148273:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.148281:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.148293:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664292.148322:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.148492:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664292.148530:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664292.148534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208384 00000100:00100000:2.0:1788664292.148541:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208384 00000100:00100000:2.0:1788664292.148593:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788664292.148603:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222208384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664292.148617:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664292.148630:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9024c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.148664:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9024c expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.148674:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9024c expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.148683:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512ba00, rc 0) 00000100:00100000:2.0:1788664292.148734:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222208384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664292.148741:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788664292.149010:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664292.149024:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.149037:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664292.149159:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.149188:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664292.149217:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664292.149303:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208512 00000100:00100000:2.0:1788664292.149308:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208512 00000100:00100000:2.0:1788664292.149338:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788664292.149473:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222208512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.149730:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222208512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664292.149781:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664292.149816:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8b68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664292.149857:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664292.149880:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c53579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664292.153219:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208640 00000100:00100000:1.0:1788664292.153234:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208640 00000100:00100000:1.0:1788664292.153278:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788664292.153287:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222208640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.153551:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788664292.153840:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8b68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.154810:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222208640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1518us (4946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664292.155452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000040:00080000:0.0:1788664292.156234:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788664292.162181:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788664292.162218:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664292.162230:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664292.162242:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664292.162481:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788664292.162485:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68d438d000 from 7 10000000:01000000:2.0:1788664292.162489:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788664292.162527:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.162536:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.162548:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664292.162584:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.162653:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664292.162739:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664292.164211:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208768 00000100:00100000:1.0:1788664292.164227:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208768 00000100:00100000:1.0:1788664292.164363:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788664292.164374:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222208768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664292.164394:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664292.164415:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9025a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.164446:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9025a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.164458:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9025a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664292.164468:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479600, rc 0) 00000100:00100000:1.0:1788664292.164539:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222208768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664292.164547:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788664292.166192:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664292.166220:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.166233:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664292.166322:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.166512:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664292.166555:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664292.166625:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222208896 00000100:00100000:1.0:1788664292.166631:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222208896 00000100:00100000:1.0:1788664292.166683:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788664292.166692:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222208896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.167267:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222208896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 573us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664292.167277:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788664292.172077:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222208896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.172153:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222209024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.172228:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664292.172279:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664292.172298:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209024 00000100:00100000:0.0:1788664292.172305:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209024 00000100:00100000:0.0:1788664292.172475:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788664292.172485:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222209024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664292.172714:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222209024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664292.172722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788664292.180133:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222209024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788664292.181979:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788664292.182298:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788664292.182322:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664292.182456:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.182470:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664292.663601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664292.663684:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345216 00000100:00100000:2.0:1788664292.663695:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345216 00000100:00100000:2.0:1788664292.663762:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 240 00000100:00100000:2.0:1788664292.663773:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:5602:x1875550204345216:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664292.663795:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664292.663827:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.663857:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.663869:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664292.663878:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512a200, rc 0) 00000100:00100000:2.0:1788664292.663940:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204345216:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 168us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664292.663947:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 240 00000100:00100000:0.0:1788664292.668172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664292.668374:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345344 00000100:00100000:2.0:1788664292.668385:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345344 00000100:00100000:2.0:1788664292.668440:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00100000:2.0:1788664292.668450:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204345344:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664292.668745:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204345344:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 295us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664292.668754:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00100000:0.0:1788664292.685026:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664292.685405:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345472 00000100:00100000:1.0:1788664292.685427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345472 00000100:00100000:0.0:1788664292.685544:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 242 00000100:00100000:0.0:1788664292.685555:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204345472:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664292.685788:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204345472:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 235us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664292.685797:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 242 00000100:00100000:3.0:1788664292.705823:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664292.705911:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345600 00000100:00100000:0.0:1788664292.705922:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345600 00000100:00100000:0.0:1788664292.705992:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 243 00000100:00100000:0.0:1788664292.706012:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204345600:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664292.706046:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664292.706066:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664292.706097:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664292.706110:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664292.706120:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee600, rc 0) 00000100:00100000:0.0:1788664292.706191:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204345600:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 181us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664292.706199:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 243 00000100:00100000:0.0:1788664292.710027:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664292.710120:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345728 00000100:00100000:1.0:1788664292.710130:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345728 00000100:00100000:1.0:1788664292.710185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 244 00000100:00100000:1.0:1788664292.710195:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204345728:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.710539:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204345728:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 345us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664292.710548:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 244 00000100:00100000:1.0:1788664292.713634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664292.713735:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345856 00000100:00100000:3.0:1788664292.713745:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345856 00000100:00100000:1.0:1788664292.714041:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 245 00000100:00100000:1.0:1788664292.714054:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204345856:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664292.714298:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204345856:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 246us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664292.714307:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 245 00000100:00100000:0.0:1788664293.151700:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222209408:0@lo:400:kworker.0 00000100:00100000:0.0:1788664293.151792:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664293.151865:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788664293.151872:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222209280:0@lo:400:kworker.0 00000100:00100000:0.0:1788664293.151900:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664293.151921:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222209792:0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.152071:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222209152:0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.152124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664293.152161:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222209664:0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.152191:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664293.152406:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664293.152415:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222209536:0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.152525:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664293.152563:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209536 00000100:00100000:1.0:1788664293.152572:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209536 00000100:00100000:1.0:1788664293.152631:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788664293.152641:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222209536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.152709:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222209536:12345-0@lo:400:kworker.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664293.152717:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788664293.152757:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e07480 x1875550222209536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664293.152772:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222209536:0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.152819:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209408 00000100:00100000:1.0:1788664293.152822:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209408 00000100:00100000:1.0:1788664293.152851:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209280 00000100:00100000:1.0:1788664293.152855:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209280 00000100:00100000:1.0:1788664293.152867:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209664 00000100:00100000:1.0:1788664293.152869:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209664 00000100:00100000:1.0:1788664293.152885:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788664293.152892:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222209408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.152925:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222209408:12345-0@lo:400:kworker.0 Request processed in 34us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664293.152932:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788664293.153074:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788664293.153085:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222209280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664293.153118:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222209280:12345-0@lo:400:kworker.0 Request processed in 36us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664293.153123:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788664293.153369:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664293.153403:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222209408:0@lo:400:kworker.0 00000100:00100000:0.0:1788664293.153420:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222209280:0@lo:400:kworker.0 00010000:00010000:2.0:1788664293.153570:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664293.153677:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664293.153683:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664293.154063:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209152 00000100:00100000:0.0:1788664293.154079:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209152 00000100:00100000:0.0:1788664293.154126:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788664293.154134:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222209152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664293.154187:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222209152:12345-0@lo:400:kworker.0 Request processed in 54us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664293.154193:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788664293.154578:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788664293.154591:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222209664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664293.154629:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222209664:12345-0@lo:400:kworker.0 Request processed in 42us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664293.154635:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788664293.158194:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209792 00000100:00100000:0.0:1788664293.158205:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209792 00000100:00100000:0.0:1788664293.158277:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788664293.158288:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222209792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664293.158398:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222209792:12345-0@lo:400:kworker.0 Request processed in 111us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664293.158405:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788664293.158452:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222209152:0@lo:400:kworker.0 00000100:00100000:0.0:1788664293.158469:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222209664:0@lo:400:kworker.0 00010000:00080000:0.0:1788664293.158523:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e04700 x1875550222209792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664293.158535:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222209792:0@lo:400:kworker.0 00000100:00080000:2.0:1788664293.159624:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664293.663490:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222209920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664293.663561:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664293.663683:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222209920 00000100:00100000:1.0:1788664293.663693:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222209920 00000100:00100000:1.0:1788664293.663743:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788664293.663753:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222209920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664293.663810:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664293.663864:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222209920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664293.663872:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788664293.663951:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e04700 x1875550222209920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664293.663972:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222209920:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664294.177678:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664294.838633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664294.838688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664294.838724:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664294.838764:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204346112 00000100:00100000:3.0:1788664294.838776:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204346112 00000100:00100000:3.0:1788664294.838852:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204346240 00000100:00100000:3.0:1788664294.838855:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204346240 00000100:00100000:3.0:1788664294.838880:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:3.0:1788664294.838890:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204346112:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664294.839303:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204346112:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 413us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664294.839313:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:3.0:1788664294.839332:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:3.0:1788664294.839374:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204346240:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664294.839418:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204346240:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 79us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664294.839425:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00080000:3.0:1788664294.839459:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664294.840305:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204345984 00000100:00100000:1.0:1788664294.840316:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204345984 00000100:00100000:1.0:1788664294.840459:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 247 00000100:00100000:1.0:1788664294.840468:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204345984:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664294.840516:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204345984:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 49us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664294.840524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 247 00010000:00010000:0.0:1788664295.202614:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664295.540859:0:11375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788664296.223712:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664296.737484:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664296.737513:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222210048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664296.737585:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664296.737678:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210048 00000100:00100000:0.0:1788664296.737709:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210048 00000100:00080000:1.0:1788664296.737901:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664296.737973:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788664296.737984:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222210048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664296.738028:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664296.739073:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222210048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1087us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664296.739083:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788664296.750264:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8cdf100 x1875550222210048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664296.750297:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222210048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664297.247689:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664298.272559:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664298.273984:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222210304:0@lo:400:kworker.0 00000100:00100000:3.0:1788664298.274072:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664298.274236:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664298.274253:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222210176:0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.274291:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664298.274339:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210176 00000100:00100000:2.0:1788664298.274373:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210176 00000100:00100000:2.0:1788664298.274425:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788664298.274434:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222210176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664298.274737:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664298.274745:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222210432:0@lo:400:kworker.0 00000100:00100000:3.0:1788664298.274811:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664298.274856:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210304 00000100:00100000:3.0:1788664298.274861:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210304 00000100:00100000:3.0:1788664298.274893:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210432 00000100:00100000:3.0:1788664298.274896:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210432 00000100:00100000:3.0:1788664298.274927:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788664298.274935:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222210304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788664298.275828:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664298.275853:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222210688:0@lo:400:kworker.0 00000100:00100000:1.0:1788664298.276296:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788664298.276315:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222210432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.278383:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222210176:12345-0@lo:400:kworker.0 Request processed in 3941us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664298.278398:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788664298.278481:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222210560:0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.278522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664298.278572:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222210176:0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.278877:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222210816:0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.278910:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664298.278955:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222210304:0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.279004:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210560 00000100:00100000:2.0:1788664298.279010:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210560 00000100:00100000:2.0:1788664298.279066:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210816 00000100:00100000:2.0:1788664298.279070:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210816 00000100:00100000:2.0:1788664298.279092:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788664298.279101:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222210560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.279174:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222210560:12345-0@lo:400:kworker.0 Request processed in 74us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664298.279181:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788664298.279195:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664298.279202:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222210816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664298.279234:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222210816:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664298.279240:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788664298.279260:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664298.279263:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788664298.279283:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8936680 x1875550222210560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664298.279295:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222210560:0@lo:400:kworker.0 00010000:00080000:2.0:1788664298.279322:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3417100 x1875550222210816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664298.279330:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3417100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222210816:0@lo:400:kworker.0 00000100:00100000:0.0:1788664298.279498:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664298.279772:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222210432:12345-0@lo:400:kworker.0 Request processed in 3463us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664298.279783:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788664298.279803:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210688 00000100:00100000:1.0:1788664298.279808:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210688 00000100:00100000:1.0:1788664298.279844:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788664298.279852:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222210688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664298.279891:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222210688:12345-0@lo:400:kworker.0 Request processed in 40us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664298.279906:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788664298.279926:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664298.280019:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222210432:0@lo:400:kworker.0 00000100:00100000:0.0:1788664298.280044:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222210688:0@lo:400:kworker.0 00000100:00100000:3.0:1788664298.285618:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222210304:12345-0@lo:400:kworker.0 Request processed in 10671us (11533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664298.285634:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788664298.787472:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222210944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664298.787558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664298.787759:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222210944 00000100:00100000:2.0:1788664298.787766:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222210944 00000100:00100000:2.0:1788664298.787827:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788664298.787839:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222210944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664298.787881:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664298.787936:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222210944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664298.787964:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788664298.788108:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1ea00 x1875550222210944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664298.788128:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222210944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788664299.297577:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664299.501328:0:11476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:11:38 (1788664298) === 00000100:00100000:0.0:1788664299.795195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664299.795247:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664299.795386:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204346496 00000100:00100000:3.0:1788664299.795400:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204346496 00000100:00100000:3.0:1788664299.795482:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:3.0:1788664299.795496:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:9698:x1875550204346496:12345-192.168.202.14@tcp:700:mkdir.0 00000100:00100000:3.0:1788664299.795593:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3414e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:9698:x1875550204346496:12345-192.168.202.14@tcp:700:mkdir.0 Request processed in 100us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664299.795601:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788664299.796123:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204346368 00000100:00100000:1.0:1788664299.796128:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204346368 00000100:00100000:1.0:1788664299.796163:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:1.0:1788664299.796169:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204346368:12345-192.168.202.14@tcp:41:mkdir.0 00000004:00000024:1.0:1788664299.796198:0:7653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788664299.796249:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3415c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204346368:12345-192.168.202.14@tcp:41:mkdir.0 Request processed in 80us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664299.796254:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00080000:0.0:1788664299.796602:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664299.799159:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664299.799257:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204346752 00000100:00100000:2.0:1788664299.799267:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204346752 00000100:00100000:2.0:1788664299.799329:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788664299.799392:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:9698:x1875550204346752:12345-192.168.202.14@tcp:36:mkdir.0 00010000:00010000:2.0:1788664299.799482:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664299.801021:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ba00/0x762f55027be90157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243663 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.801061:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:2.0:1788664299.801093:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664299.801506:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.801523:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.801536:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.808173:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.808196:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.808222:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664299.809840:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788664299.809857:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.809868:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.809876:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.809883:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664299.809888:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.809897:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.809913:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff400) 00010000:00010000:2.0:1788664299.809917:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664299.809922:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.809929:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90276 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664299.809954:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1d4dced reply state 0000000093f7fc2a transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664299.809976:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664299.810121:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:9698:x1875550204346752:12345-192.168.202.14@tcp:36:mkdir.0 Request processed in 10774us (10962us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788664299.810131:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00010000:00010000:0.0:1788664299.814431:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.814450:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.814457:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.814474:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664299.814492:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.814500:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.814521:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b68e9afff00) 00010000:00010000:0.0:1788664299.814524:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664299.814530:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.814537:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9027d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664299.822980:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664299.823062:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204346880 00000100:00100000:1.0:1788664299.823070:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204346880 00000100:00100000:1.0:1788664299.823115:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788664299.823122:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:9699:x1875550204346880:12345-192.168.202.14@tcp:101:chmod.0 00010000:00010000:1.0:1788664299.823145:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664299.823166:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436e8 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.823231:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9028b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.823242:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9028b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.823252:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9028b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664299.823288:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788664299.823304:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664299.823372:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9028b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.823399:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e8 expref: 8 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.823416:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9028b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e8 expref: 7 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.823423:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68dc969800) 00010000:00010000:1.0:1788664299.823426:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664299.823429:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479400, rc 0) 00000100:00100000:1.0:1788664299.823626:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:9699:x1875550204346880:12345-192.168.202.14@tcp:101:chmod.0 Request processed in 502us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664299.823631:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788664299.830525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664299.830662:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204347136 00000100:00100000:3.0:1788664299.830673:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204347136 00000100:00100000:3.0:1788664299.830734:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:3.0:1788664299.830747:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:9699:x1875550204347136:12345-192.168.202.14@tcp:36:chmod.0 00010000:00010000:3.0:1788664299.830855:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664299.830888:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9028b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e8 expref: 7 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.830915:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68dc969800) 00010000:00010000:3.0:1788664299.830927:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664299.830959:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.830984:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.830995:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664299.831331:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d0c645a reply state 000000004ea0581a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664299.831397:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788664299.831409:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788664299.831898:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:9699:x1875550204347136:12345-192.168.202.14@tcp:36:chmod.0 Request processed in 1153us (1383us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788664299.831907:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00010000:00010000:0.0:1788664299.833728:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.833749:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.833759:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.833767:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664299.833772:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.833790:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.833813:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811800) 00010000:00010000:0.0:1788664299.833850:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664299.833859:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.833866:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90292 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664299.876728:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664299.877115:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204347264 00000100:00100000:3.0:1788664299.877127:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204347264 00000100:00100000:3.0:1788664299.877197:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:3.0:1788664299.877208:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:9700:x1875550204347264:12345-192.168.202.14@tcp:101:chown.0 00010000:00010000:3.0:1788664299.877238:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664299.877265:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90299 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436ef expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.877386:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be902a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.877402:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be902a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.877414:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be902a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664299.877456:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788664299.877460:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664299.877513:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be902a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.877545:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90299 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436ef expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.877563:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be902a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436ef expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664299.877572:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811400) 00010000:00010000:3.0:1788664299.877574:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664299.877578:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a200, rc 0) 00000100:00100000:3.0:1788664299.877640:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+8:9700:x1875550204347264:12345-192.168.202.14@tcp:101:chown.0 Request processed in 434us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664299.877647:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:3.0:1788664299.884200:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664299.884316:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204347392 00000100:00100000:2.0:1788664299.884328:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204347392 00000100:00100000:2.0:1788664299.884448:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788664299.884460:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:9700:x1875550204347392:12345-192.168.202.14@tcp:101:chown.0 00010000:00010000:2.0:1788664299.884487:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664299.884510:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be902a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436f6 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.884605:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.884620:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.884633:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.884650:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.884658:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.884665:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885262:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be902bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885273:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be902bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885282:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be902bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664299.885326:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788664299.885333:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664299.885378:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be902bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885393:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885400:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885407:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885413:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664299.885418:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885425:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885438:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811400) 00010000:00010000:2.0:1788664299.885450:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664299.885455:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885462:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be902ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885475:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885481:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885487:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885491:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664299.885494:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885499:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885507:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b68e9aff400) 00010000:00010000:2.0:1788664299.885510:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664299.885512:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885519:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be902b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885570:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be902a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436f6 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885596:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be902bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436f6 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.885603:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664299.885606:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664299.885608:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215a000, rc 0) 00000100:00100000:2.0:1788664299.885732:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:9700:x1875550204347392:12345-192.168.202.14@tcp:101:chown.0 Request processed in 1273us (1542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664299.885741:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:0.0:1788664299.897621:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664299.897701:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204347648 00000100:00100000:1.0:1788664299.897712:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204347648 00000100:00100000:1.0:1788664299.897794:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788664299.897806:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+9:9700:x1875550204347648:12345-192.168.202.14@tcp:36:chown.0 00010000:00010000:1.0:1788664299.897904:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664299.897932:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be902bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436f6 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.897951:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:1.0:1788664299.897961:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664299.898000:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.898013:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664299.898023:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664299.939173:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d364c0b8 reply state 00000000f9ad6c09 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664299.939192:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788664299.939210:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788664299.939382:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+10:9700:x1875550204347648:12345-192.168.202.14@tcp:36:chown.0 Request processed in 41574us (41914us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788664299.939392:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000001:00080000:2.0:1788664299.940136:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1788664299.940218:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.940229:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.940236:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.940243:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664299.940248:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.940256:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.940291:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68dc969100) 00010000:00010000:0.0:1788664299.940294:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664299.940300:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664299.940307:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664299.958869:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664299.959046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204347776 00000100:00100000:3.0:1788664299.959070:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204347776 00000100:00100000:3.0:1788664299.959137:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 249 00000100:00100000:3.0:1788664299.959147:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204347776:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664299.959237:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204347776:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 91us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664299.959245:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 249 00000100:00100000:1.0:1788664299.967058:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664299.967169:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204347904 00000100:00100000:3.0:1788664299.967179:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204347904 00000100:00100000:3.0:1788664299.967306:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:3.0:1788664299.967317:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204347904:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664299.967438:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204347904:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 122us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664299.967447:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00080000:0.0:1788664299.971739:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664299.976400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664299.976492:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204348032 00000100:00100000:3.0:1788664299.976504:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204348032 00000100:00100000:3.0:1788664299.976569:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:3.0:1788664299.976581:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:9701:x1875550204348032:12345-192.168.202.14@tcp:101:touch.500 00010000:00010000:3.0:1788664299.976610:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664299.976633:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2436fd expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664299.981879:0:5856:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5182us 00010000:00010000:2.0:1788664299.996923:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.996950:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.996963:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.996981:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997001:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997009:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997379:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ac00/0x762f55027be902df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997390:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ac00/0x762f55027be902df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997399:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ac00/0x762f55027be902df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664299.997429:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788664299.997434:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664299.997479:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ac00/0x762f55027be902df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997492:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997499:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997506:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997512:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215a800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664299.997516:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997523:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997535:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811400) 00010000:00010000:2.0:1788664299.997543:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664299.997550:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997556:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be902d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997569:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997575:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997580:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997586:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215ba00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664299.997589:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997594:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997601:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b68e9aff400) 00010000:00010000:2.0:1788664299.997603:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664299.997607:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997612:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be902d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997662:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436fd expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997691:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ac00/0x762f55027be902df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436fd expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664299.997699:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:2.0:1788664299.997701:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788664299.997704:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215ac00, rc 0) 00000100:00100000:2.0:1788664299.997938:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:9701:x1875550204348032:12345-192.168.202.14@tcp:101:touch.500 Request processed in 21356us (21544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664299.997948:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788664300.014526:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664300.014609:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204348288 00000100:00100000:3.0:1788664300.014621:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204348288 00000100:00100000:3.0:1788664300.014690:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:3.0:1788664300.014701:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:9701:x1875550204348288:12345-192.168.202.14@tcp:101:touch.500 00010000:00010000:3.0:1788664300.014724:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664300.014757:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be902e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243704 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.015110:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.015127:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.015141:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.016729:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.016753:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.016764:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788664300.017688:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788664300.021648:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.021673:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.021688:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.021737:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.021744:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.021751:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.021757:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664300.021762:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.022078:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.022093:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:1.0:1788664300.022096:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664300.022102:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.022111:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be902ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664300.022128:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9aed8b0 reply state 00000000282c169f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664300.022139:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788664300.022191:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be902e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243704 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.022207:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243704 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664300.022215:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68dc969a00) 00010000:00010000:1.0:1788664300.022217:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664300.022220:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478600, rc 0) 00000100:00100000:1.0:1788664300.022878:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+10:9701:x1875550204348288:12345-192.168.202.14@tcp:101:touch.500 Request processed in 8175us (8357us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788664300.022889:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00010000:00010000:0.0:1788664300.037512:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.037531:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.037539:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.037546:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664300.037551:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.037559:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.037576:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9b68c3811700) 00010000:00010000:0.0:1788664300.037580:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664300.037584:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.037605:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be902f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664300.040383:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664300.040597:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204348544 00000100:00100000:0.0:1788664300.040608:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204348544 00000100:00100000:0.0:1788664300.040671:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788664300.040682:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+9:9701:x1875550204348544:12345-192.168.202.14@tcp:36:touch.500 00010000:00010000:0.0:1788664300.040764:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664300.040794:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be902fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243704 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.040819:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68dc969a00) 00010000:00010000:0.0:1788664300.040834:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664300.040900:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.040914:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.040925:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664300.041210:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d2308ec reply state 000000002a0fccc8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664300.041221:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664300.041314:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+10:9701:x1875550204348544:12345-192.168.202.14@tcp:36:touch.500 Request processed in 633us (979us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788664300.041322:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00010000:00010000:0.0:1788664300.052719:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.052739:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.052747:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.052753:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664300.052758:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664300.052776:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.053045:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204348672 00000100:00100000:2.0:1788664300.053066:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204348672 00010000:00010000:0.0:1788664300.053161:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.053186:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68e1346500) 00010000:00010000:0.0:1788664300.053190:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664300.053195:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.053203:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90309 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664300.053274:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788664300.053286:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:9701:x1875550204348672:12345-192.168.202.14@tcp:101:touch.500 00010000:00010000:2.0:1788664300.053318:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664300.053375:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be90310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24370b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.053451:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be90310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24370b expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.053467:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be90310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24370b expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.053487:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68e9aff400) 00010000:00010000:2.0:1788664300.053490:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664300.053500:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215ba00, rc 0) 00000100:00100000:2.0:1788664300.053566:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+10:9701:x1875550204348672:12345-192.168.202.14@tcp:101:touch.500 Request processed in 282us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.053573:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:1.0:1788664300.057449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.057583:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204348800 00000100:00100000:2.0:1788664300.057595:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204348800 00000100:00100000:2.0:1788664300.057646:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788664300.057654:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875550204348800:12345-192.168.202.14@tcp:8:touch.500 00010000:00080000:2.0:1788664300.057691:0:8476:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:2.0:1788664300.057724:0:8476:0:(genops.c:1385:class_connect()) connect: client 5e600724-38bd-4119-be7d-5264f08f0aa5, cookie 0x762f55027be90317 00002000:00100000:2.0:1788664300.057736:0:8476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5e600724-38bd-4119-be7d-5264f08f0aa5/ffff9b68d1aa6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788664300.057761:0:8476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b6, return b6 00002000:00080000:2.0:1788664300.058030:0:8476:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788664300.058281:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9b68d1aa4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788664300.058485:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2357:x1875550204348800:12345-192.168.202.14@tcp:8:touch.500 Request processed in 829us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.058494:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788664300.060904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.060969:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204348928 00000100:00100000:2.0:1788664300.060981:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204348928 00000100:00080000:0.0:1788664300.061036:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664300.061165:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:1.0:1788664300.061180:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:0:x1875550204348928:12345-192.168.202.14@tcp:2:touch.500 00000001:00080000:2.0:1788664300.108860:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1788664300.108890:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000100:00100000:2.0:1788664300.113703:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:0:x1875550204348928:12345-192.168.202.14@tcp:2:touch.500 Request processed in 52508us (52922us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788664300.113718:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:1.0:1788664300.123606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.123918:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204349184 00000100:00100000:2.0:1788664300.123932:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204349184 00000100:00100000:2.0:1788664300.124062:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:2.0:1788664300.124087:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+10:9701:x1875550204349184:12345-192.168.202.14@tcp:35:touch.500 00000100:00100000:2.0:1788664300.124546:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:9701:x1875550204349184:12345-192.168.202.14@tcp:35:touch.500 Request processed in 459us (952us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788664300.124554:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:1.0:1788664300.140932:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.141020:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204349312 00000100:00100000:2.0:1788664300.141031:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204349312 00000100:00100000:2.0:1788664300.141133:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788664300.141142:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+11:9702:x1875550204349312:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:2.0:1788664300.141164:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664300.141182:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be9031e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243712 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.141244:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a600/0x762f55027be90325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.141255:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a600/0x762f55027be90325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.141263:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a600/0x762f55027be90325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664300.141297:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788664300.141300:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664300.141331:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a600/0x762f55027be90325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.141387:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be9031e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243712 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.141416:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a600/0x762f55027be90325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243712 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.141422:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:2.0:1788664300.141424:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664300.141427:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215a600, rc 0) 00000100:00100000:2.0:1788664300.141467:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+12:9702:x1875550204349312:12345-192.168.202.14@tcp:101:rm.0 Request processed in 327us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.141483:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:1.0:1788664300.145537:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664300.153284:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204349568 00000100:00100000:0.0:1788664300.153304:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204349568 00000100:00100000:0.0:1788664300.153416:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:0.0:1788664300.153427:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+12:9702:x1875550204349568:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:0.0:1788664300.153451:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664300.153477:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9032c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243719 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664300.153930:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788664300.154436:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9032c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243719 expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.154454:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811400) 00010000:00010000:0.0:1788664300.154457:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664300.154463:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9032c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243719 expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.154481:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efc00, rc 0) 00000100:00100000:0.0:1788664300.155290:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:9702:x1875550204349568:12345-192.168.202.14@tcp:101:rm.0 Request processed in 1860us (9756us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788664300.155301:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:1.0:1788664300.161075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664300.161136:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204349696 00000100:00100000:0.0:1788664300.161145:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204349696 00000100:00100000:0.0:1788664300.161205:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:0.0:1788664300.161214:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+13:9702:x1875550204349696:12345-192.168.202.14@tcp:37:rm.0 00000100:00100000:3.0:1788664300.175324:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+13:9702:x1875550204349696:12345-192.168.202.14@tcp:37:rm.0 Request processed in 14098us (14315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664300.175357:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:2.0:1788664300.181997:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664300.182159:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204349952 00000100:00100000:0.0:1788664300.182169:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204349952 00000100:00100000:0.0:1788664300.182227:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788664300.182238:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7ebb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:9702:x1875550204349952:12345-192.168.202.14@tcp:35:rm.0 00000100:00100000:0.0:1788664300.182523:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7ebb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+14:9702:x1875550204349952:12345-192.168.202.14@tcp:35:rm.0 Request processed in 286us (535us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788664300.182531:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:1.0:1788664300.191470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.191616:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204350208 00000100:00100000:2.0:1788664300.191629:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204350208 00000100:00100000:2.0:1788664300.191694:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:2.0:1788664300.191705:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+14:9702:x1875550204350208:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:2.0:1788664300.191732:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664300.191767:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be9033a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243720 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.191891:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215b200/0x762f55027be90341 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.191906:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215b200/0x762f55027be90341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.191918:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215b200/0x762f55027be90341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664300.191950:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788664300.192127:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a800/0x762f55027be9033a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243720 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.192148:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215b200/0x762f55027be90341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243720 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.192158:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:2.0:1788664300.192161:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664300.192164:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b690215b200, rc 0) 00000100:00100000:2.0:1788664300.192230:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+16:9702:x1875550204350208:12345-192.168.202.14@tcp:101:rm.0 Request processed in 528us (771us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788664300.192238:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:1.0:1788664300.195631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.195773:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204350336 00000100:00100000:2.0:1788664300.195786:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204350336 00000100:00100000:2.0:1788664300.195869:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:2.0:1788664300.195881:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+16:9702:x1875550204350336:12345-192.168.202.14@tcp:41:rm.0 00000004:00000024:2.0:1788664300.195971:0:5856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788664300.196076:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+16:9702:x1875550204350336:12345-192.168.202.14@tcp:41:rm.0 Request processed in 196us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.196084:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:1.0:1788664300.199299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.199630:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204350464 00000100:00100000:2.0:1788664300.199642:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204350464 00000100:00100000:2.0:1788664300.199698:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:2.0:1788664300.199709:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+16:9702:x1875550204350464:12345-192.168.202.14@tcp:101:rm.0 00010000:00010000:2.0:1788664300.199753:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664300.199791:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215b800/0x762f55027be9034f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243727 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.199891:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.199908:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.199923:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.199941:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.199948:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.199954:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200081:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200090:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200098:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664300.200127:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788664300.200137:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664300.200158:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200171:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200180:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200187:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200195:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200201:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664300.200206:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200214:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200225:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:2.0:1788664300.200228:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664300.200233:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200240:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a400/0x762f55027be90356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200254:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200269:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200275:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200280:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215a000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664300.200283:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200289:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200296:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9b68e9affb00) 00010000:00010000:2.0:1788664300.200299:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664300.200301:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200307:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a000/0x762f55027be9035d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200338:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215b800/0x762f55027be9034f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243727 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200390:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243727 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.200399:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68e9aff400) 00010000:00010000:2.0:1788664300.200401:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664300.200409:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b400, rc 0) 00000100:00100000:2.0:1788664300.200462:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+17:9702:x1875550204350464:12345-192.168.202.14@tcp:101:rm.0 Request processed in 755us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664300.200469:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:0.0:1788664300.209908:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.210125:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204350720 00000100:00100000:2.0:1788664300.210139:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204350720 00000100:00100000:2.0:1788664300.210199:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:2.0:1788664300.210210:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+17:9702:x1875550204350720:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:2.0:1788664300.210281:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788664300.210315:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be90364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243727 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210375:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ba00/0x762f55027be90310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24370b expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210391:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68e9aff400) 00010000:00010000:2.0:1788664300.210409:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215a600/0x762f55027be90325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243712 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210422:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:2.0:1788664300.210426:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664300.210456:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210473:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210484:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210514:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210532:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210539:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210676:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210685:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.210692:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664300.211695:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788664300.211709:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334195366985ns, next at 335195363673ns, rc = 0 00010000:00010000:2.0:1788664300.211784:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211798:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211808:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211817:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211835:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211841:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211877:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664300.211905:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211911:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211918:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211925:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eaa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664300.211930:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211939:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211952:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68e9aff300) 00010000:00010000:2.0:1788664300.211955:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788664300.211960:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211967:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90379 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.211987:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.212001:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.212007:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.212012:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664300.212015:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.212021:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.212030:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:2.0:1788664300.212033:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664300.212036:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.212042:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be9036b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664300.212052:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df8bd03f reply state 00000000d3d79123 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664300.212060:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788664300.213286:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664300.213299:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.213309:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664300.213313:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.213322:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.213337:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b68e9aff300) 00010000:00010000:0.0:1788664300.213355:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788664300.213359:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.213365:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90380 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.213389:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664300.213391:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664300.213392:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664300.214221:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+16:9702:x1875550204350720:12345-192.168.202.14@tcp:36:rm.0 Request processed in 4004us (4318us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788664300.214233:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00010000:00010000:0.0:1788664300.219460:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.219479:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.219486:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.219492:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664300.219497:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.219520:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.219539:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x51ee4c24 (ffff9b68e9aff200) 00010000:00010000:0.0:1788664300.219542:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664300.219547:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.219554:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b000/0x762f55027be90372 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x51ee4c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664300.223459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.223945:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204350976 00000100:00100000:2.0:1788664300.223960:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204350976 00000100:00100000:2.0:1788664300.224048:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:2.0:1788664300.224061:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+15:9702:x1875550204350976:12345-192.168.202.14@tcp:35:rm.0 00000100:00100000:2.0:1788664300.224331:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+16:9702:x1875550204350976:12345-192.168.202.14@tcp:35:rm.0 Request processed in 271us (882us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788664300.224366:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788664300.231856:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664300.232725:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204351232 00000100:00100000:2.0:1788664300.232739:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204351232 00000100:00100000:2.0:1788664300.232818:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:2.0:1788664300.232829:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+16:9702:x1875550204351232:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:2.0:1788664300.232910:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788664300.232939:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215b200/0x762f55027be90341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243720 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.232965:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b690215ac00/0x762f55027be902df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436fd expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.232978:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9aff100) 00010000:00010000:2.0:1788664300.232996:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be902a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436ef expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.233007:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68c3811400) 00010000:00010000:2.0:1788664300.233200:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664300.233237:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.233250:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.233281:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.233293:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.233299:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.233305:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.236161:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.236188:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.236201:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664300.237008:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788664300.237028:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237037:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237043:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237050:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ebe00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664300.237063:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237071:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237086:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b68e9affc00) 00010000:00010000:2.0:1788664300.237090:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788664300.237096:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237103:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90395 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237132:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237139:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237145:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237150:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eaa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664300.237153:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237159:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237167:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff400) 00010000:00010000:2.0:1788664300.237169:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664300.237178:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664300.237184:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90387 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664300.237198:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000feebdc8c reply state 000000002886fddf transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664300.237207:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664300.238379:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+15:9702:x1875550204351232:12345-192.168.202.14@tcp:36:rm.0 Request processed in 5537us (6521us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788664300.238392:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00010000:00010000:3.0:1788664300.244980:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.245001:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.245042:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.245049:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664300.245055:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.245066:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.245093:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b68e9affb00) 00010000:00010000:3.0:1788664300.245097:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664300.245102:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664300.245109:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9038e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664300.319762:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664301.343470:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788664301.858273:0:6971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335841927529ns, next at 336841925055ns, rc = 0 00000100:00100000:0.0:1788664301.858511:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222211072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664301.858587:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664301.858696:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211072 00000100:00100000:1.0:1788664301.858705:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211072 00000100:00100000:1.0:1788664301.858806:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788664301.858816:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222211072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664301.858841:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664301.858890:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222211072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664301.858898:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788664301.860516:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788664301.860885:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8cdf800 x1875550222211072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664301.860910:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222211072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788664302.367927:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664303.391993:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664303.393272:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222211456:0@lo:400:kworker.0 00000100:00100000:2.0:1788664303.393367:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664303.393437:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664303.393444:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222211328:0@lo:400:kworker.0 00000100:00100000:2.0:1788664303.393471:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664303.393490:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222211840:0@lo:400:kworker.0 00000100:00100000:2.0:1788664303.393516:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664303.393684:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222211584:0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.393752:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222211200:0@lo:400:kworker.0 00000100:00100000:3.0:1788664303.394460:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211456 00000100:00100000:3.0:1788664303.394528:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211456 00000100:00100000:3.0:1788664303.394598:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211328 00000100:00100000:3.0:1788664303.394602:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211328 00000100:00100000:3.0:1788664303.394629:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788664303.394638:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222211456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664303.395655:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788664303.395715:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664303.395744:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211840 00000100:00100000:1.0:1788664303.395751:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211840 00000100:00100000:1.0:1788664303.395791:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211584 00000100:00100000:1.0:1788664303.395793:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211584 00000100:00100000:1.0:1788664303.395812:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788664303.395833:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222211840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396085:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664303.396125:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222211712:0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396161:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664303.396185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211200 00000100:00100000:0.0:1788664303.396198:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211200 00000100:00100000:0.0:1788664303.396245:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788664303.396254:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222211200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396291:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222211200:12345-0@lo:400:kworker.0 Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.396299:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788664303.396362:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222211200:0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396407:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788664303.396415:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222211584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222211584:12345-0@lo:400:kworker.0 Request processed in 42us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.396461:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788664303.396478:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664303.396482:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788664303.396515:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8936680 x1875550222211584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664303.396541:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222211584:0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396582:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211712 00000100:00100000:0.0:1788664303.396586:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211712 00000100:00100000:0.0:1788664303.396614:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788664303.396622:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222211328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396658:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222211328:12345-0@lo:400:kworker.0 Request processed in 37us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.396664:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788664303.396677:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788664303.396683:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222211712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664303.396723:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222211712:12345-0@lo:400:kworker.0 Request processed in 40us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.396729:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788664303.396747:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664303.396763:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222211712:0@lo:400:kworker.0 00000100:00100000:2.0:1788664303.411336:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222211328:0@lo:400:kworker.0 00000100:00100000:3.0:1788664303.417847:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222211456:12345-0@lo:400:kworker.0 Request processed in 23199us (24470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664303.417864:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788664303.418033:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222211456:0@lo:400:kworker.0 00000100:00100000:1.0:1788664303.418678:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222211840:12345-0@lo:400:kworker.0 Request processed in 22843us (25157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664303.418689:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788664303.418772:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e04700 x1875550222211840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664303.418785:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222211840:0@lo:400:kworker.0 00000100:00100000:3.0:1788664303.903932:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664303.903977:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222211968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664303.904052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664303.904499:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222211968 00000100:00100000:0.0:1788664303.904508:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222211968 00000100:00100000:0.0:1788664303.904562:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788664303.904573:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222211968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664303.904611:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664303.904659:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222211968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664303.904666:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788664303.904757:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c3e04700 x1875550222211968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664303.904776:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222211968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788664304.422761:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788664304.524042:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:0.0:1788664304.998549:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000004:00080000:0.0:1788664304.998583:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788664304.998608:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788664304.998615:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788664304.998842:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664304.998864:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222212096:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788664304.998951:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664304.999139:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222212096 00000100:00100000:2.0:1788664304.999147:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222212096 00000100:00100000:2.0:1788664304.999195:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664304.999204:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222212096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788664304.999249:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788664304.999283:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9cd9ec, atime: 0x6a9cd9ec, ctime: 0x6a9cd9ec, blocks: 0x1 00010000:00010000:2.0:1788664304.999292:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.999309:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1788664304.999313:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664304.999319:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.999337:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.999373:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.999382:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664304.999399:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788664305.000548:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222212096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1341us (1593us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788664305.000559:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788664305.000609:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664305.000616:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.000641:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664305.000646:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.000655:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.000673:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.000680:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be9039c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.000699:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664305.000701:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664305.000703:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788664305.004053:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68c612ce00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788664305.004070:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222212096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788664305.087858:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664305.087901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664305.087932:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204351488 00000100:00100000:1.0:1788664305.087940:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664305.087946:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204351488 00000100:00100000:1.0:1788664305.087987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664305.088024:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204351360 00000100:00100000:1.0:1788664305.088029:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204351360 00000100:00100000:2.0:1788664305.088050:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204351744 00000100:00100000:2.0:1788664305.088055:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204351744 00000100:00100000:1.0:1788664305.088076:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 251 00000100:00100000:1.0:1788664305.088091:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204351360:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664305.088094:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:2.0:1788664305.088117:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204351488:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664305.088203:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204351360:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 117us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664305.088212:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 251 00000100:00100000:0.0:1788664305.088804:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204351616 00000100:00100000:0.0:1788664305.088824:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204351616 00000100:00100000:0.0:1788664305.088866:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788664305.088875:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204351616:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664305.089659:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:3.0:1788664305.089674:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204351744:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664305.091481:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204351488:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 3349us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.091498:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00080000:2.0:1788664305.091585:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664305.091595:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664305.095544:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204351616:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 6317us (7203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.095564:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:3.0:1788664305.097718:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204351744:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 8037us (9803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.097736:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 108 00010000:00010000:1.0:1788664305.443628:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788664305.578846:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:0.0:1788664305.619929:0:11677:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc54380250 20000000:00000080:0.0:1788664305.619951:0:11677:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b68fb7c5800 uarg=0000000000000000 20000000:01000000:0.0:1788664305.619991:0:11677:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788664305.619999:0:11677:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788664305.620005:0:11677:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788664305.643278:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788664305.643838:0:11677:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788664305.657029:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788664305.657088:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788664305.657142:0:11677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788664305.657161:0:11677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788664305.657196:0:11677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657216:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9023e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657224:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9024c expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657231:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9025a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657241:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657247:0:11677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657255:0:11677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657297:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.657314:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 12 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.657338:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212224:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664305.658592:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.658605:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 12 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.658620:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212352:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664305.658656:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9025a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.658664:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9025a expref: 18 pid: 5849 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.658674:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212480:0@lo:104: 00000100:00100000:2.0:1788664305.658718:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664305.658757:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9024c expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.658765:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9024c expref: 18 pid: 5847 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.658773:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212608:0@lo:104: 00000100:00100000:2.0:1788664305.658795:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664305.658816:0:11677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9023e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.658825:0:11677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9023e expref: 18 pid: 5848 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.658847:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212736:0@lo:104: 00000100:00100000:2.0:1788664305.658876:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664305.658886:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664305.659100:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788664305.659113:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222212480 00000100:00100000:0.0:1788664305.659121:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222212480 00000100:00100000:0.0:1788664305.659162:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222212608 00000100:00100000:0.0:1788664305.659164:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222212608 00000100:00100000:0.0:1788664305.659195:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222212736 00000100:00100000:0.0:1788664305.659198:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222212736 00000100:00100000:0.0:1788664305.659211:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788664305.659220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:11677:x1875550222212480:12345-0@lo:104: 00010000:00010000:0.0:1788664305.659235:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659303:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664305.659310:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+5:11677:x1875550222212480:12345-0@lo:104: Request processed in 91us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.659317:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788664305.659370:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664305.659377:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:11677:x1875550222212608:12345-0@lo:104: 00010000:00010000:0.0:1788664305.659384:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659416:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788664305.659421:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+4:11677:x1875550222212608:12345-0@lo:104: Request processed in 45us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.659426:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664305.659437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664305.659443:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:11677:x1875550222212736:12345-0@lo:104: 00010000:00010000:0.0:1788664305.659450:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659478:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788664305.659483:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+3:11677:x1875550222212736:12345-0@lo:104: Request processed in 40us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664305.659487:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788664305.659539:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788664305.659545:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659552:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664305.659557:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659565:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664305.659582:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664305.659587:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664305.659617:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659623:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664305.659644:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659651:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c512a600/0x762f55027be9025a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90261 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659666:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664305.659669:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659675:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479a00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664305.659678:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659684:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664305.659689:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664305.659694:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664305.659714:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659720:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664305.659732:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659738:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1479a00/0x762f55027be9024c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90253 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659752:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664305.659755:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659761:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664305.659764:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659770:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664305.659776:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664305.659781:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664305.659792:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659797:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664305.659803:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659818:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1478200/0x762f55027be9023e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be90245 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664305.659831:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664305.659832:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664305.659834:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664305.659847:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222212864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664305.659874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664305.661604:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664305.661640:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222213120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664305.661705:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664305.661750:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664305.661756:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222212992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664305.661782:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664305.661811:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222212864 00000100:00100000:2.0:1788664305.661817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222212864 00010000:00010000:2.0:1788664305.661849:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9025a expref: 19 pid: 5849 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.661876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222213120 00000100:00100000:2.0:1788664305.661878:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222213120 00010000:00010000:2.0:1788664305.661887:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9023e expref: 20 pid: 5848 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.661897:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222212992 00000100:00100000:2.0:1788664305.661900:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222212992 00010000:00010000:2.0:1788664305.661909:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9024c expref: 21 pid: 5847 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.661921:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664305.661929:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+21:3308:x1875550222212864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664305.661942:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664305.661947:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9025a expref: 21 pid: 5849 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.661970:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9025a expref: 21 pid: 5849 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.661988:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664305.662021:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+21:3308:x1875550222212864:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.662029:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664305.662046:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664305.662053:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+20:3310:x1875550222213120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664305.662061:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664305.662065:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9023e expref: 20 pid: 5848 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.662072:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9023e expref: 20 pid: 5848 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.662081:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664305.662106:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+20:3310:x1875550222213120:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.662112:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664305.662123:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664305.662129:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5892450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222212992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664305.662136:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664305.662140:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9024c expref: 19 pid: 5847 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.662147:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9024c expref: 19 pid: 5847 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.662161:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664305.662181:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5892450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222212992:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664305.662187:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664305.662259:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222212992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664305.662266:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222213120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664305.662294:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222212864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664305.662324:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479600/0x762f55027be90261 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9025a expref: 18 pid: 5849 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.662363:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212480:0@lo:104: 00010000:00010000:2.0:1788664305.662375:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512ba00/0x762f55027be90253 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9024c expref: 17 pid: 5847 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.662383:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212608:0@lo:104: 00010000:00010000:2.0:1788664305.662392:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ee200/0x762f55027be90245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9023e expref: 16 pid: 5848 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.662400:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212736:0@lo:104: 00010000:00010000:1.0:1788664305.664822:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664305.679505:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664305.679538:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664305.679615:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204351872 00000100:00100000:3.0:1788664305.679625:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204351872 00010000:00010000:3.0:1788664305.679676:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 13 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.679714:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352000 00000100:00100000:3.0:1788664305.679718:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352000 00010000:00010000:3.0:1788664305.679729:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 14 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664305.679750:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:3.0:1788664305.679760:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+14:2361:x1875550204351872:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664305.679776:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664305.679782:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 14 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679795:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 14 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679814:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664305.679878:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+14:2361:x1875550204351872:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.679886:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:3.0:1788664305.679906:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:3.0:1788664305.679913:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204352000:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664305.679921:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664305.679925:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 13 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679935:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 13 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679949:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679958:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679973:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679980:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679986:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679993:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.679999:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664305.680010:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.680018:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.680026:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664305.680038:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664305.680058:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204352000:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 146us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664305.680065:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00010000:00010000:2.0:1788664305.680618:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ee600/0x762f55027be9026f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436e1 expref: 12 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.680635:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212224:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664305.680660:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512a200/0x762f55027be90268 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436da expref: 11 pid: 5849 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664305.680682:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11677:1875550222212352:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664305.680715:0:11677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.680725:0:11677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.680730:0:11677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664305.680737:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c12ea000/0x762f55027be903a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664306.463681:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664306.872757:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664306.872952:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352128 00000100:00100000:3.0:1788664306.872964:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352128 00000100:00100000:3.0:1788664306.873027:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 252 00000100:00100000:3.0:1788664306.873038:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:5602:x1875550204352128:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664306.873056:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664306.873076:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147ba00/0x762f55027be903aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24372e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664306.873102:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147ba00/0x762f55027be903aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24372e expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664306.873114:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147ba00/0x762f55027be903aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24372e expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664306.873122:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147ba00, rc 0) 00000100:00100000:3.0:1788664306.873187:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204352128:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 150us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664306.873211:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 252 00000100:00100000:3.0:1788664306.883644:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664306.883947:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352256 00000100:00100000:1.0:1788664306.883958:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352256 00000100:00100000:1.0:1788664306.884018:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 253 00000100:00100000:1.0:1788664306.884029:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204352256:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664306.884414:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204352256:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 384us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664306.884422:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 253 00000100:00100000:0.0:1788664306.896446:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664306.897981:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352384 00000100:00100000:1.0:1788664306.897994:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352384 00000100:00100000:1.0:1788664306.898077:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 254 00000100:00100000:1.0:1788664306.898088:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204352384:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664306.898323:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204352384:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 236us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664306.898331:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 254 00000100:00100000:0.0:1788664306.914665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664306.914764:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352512 00000100:00100000:3.0:1788664306.914774:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352512 00000100:00100000:3.0:1788664306.914849:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 255 00000100:00100000:3.0:1788664306.914860:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:9972:x1875550204352512:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664306.915132:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c92a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:9972:x1875550204352512:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 274us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664306.915141:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 255 00000100:00100000:3.0:1788664306.925079:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664306.946478:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352640 00000100:00100000:0.0:1788664306.946494:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352640 00000100:00100000:0.0:1788664306.946576:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 256 00000100:00100000:0.0:1788664306.946587:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:9972:x1875550204352640:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788664306.946888:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:9972:x1875550204352640:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 301us (21819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664306.946896:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 256 00000100:00100000:0.0:1788664306.973120:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664306.973316:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352768 00000100:00100000:3.0:1788664306.973328:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352768 00000100:00100000:3.0:1788664306.973428:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 257 00000100:00100000:3.0:1788664306.973439:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:5602:x1875550204352768:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664306.974730:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664306.974757:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b400/0x762f55027be903b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243735 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664306.974791:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b400/0x762f55027be903b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243735 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664306.974812:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b400/0x762f55027be903b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243735 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664306.974822:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b400, rc 0) 00000100:00100000:1.0:1788664306.975856:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664306.975876:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222213248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664306.975943:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664306.976029:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222213248 00000100:00100000:1.0:1788664306.976036:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222213248 00000100:00100000:1.0:1788664306.976087:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664306.976095:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222213248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664306.976130:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664306.976171:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222213248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664306.976178:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664306.976216:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788664306.976223:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68c612ce00, transno 4294967300 00000100:00100000:1.0:1788664306.976241:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222213248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664306.983402:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204352768:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 9945us (10276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664306.983437:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 257 00000100:00080000:2.0:1788664306.986768:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664306.991188:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664306.994029:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204352896 00000100:00100000:1.0:1788664306.994047:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204352896 00000100:00100000:1.0:1788664306.994124:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 258 00000100:00100000:1.0:1788664306.994134:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204352896:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664306.994952:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204352896:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 815us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664306.994962:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 258 00000100:00100000:3.0:1788664307.006854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664307.008321:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353024 00000100:00100000:1.0:1788664307.008335:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353024 00000100:00100000:1.0:1788664307.008429:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 259 00000100:00100000:1.0:1788664307.008439:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204353024:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.008929:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:5602:x1875550204353024:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 490us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664307.008938:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 259 00000100:00100000:0.0:1788664307.030525:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664307.030608:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353152 00000100:00100000:1.0:1788664307.030619:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353152 00000100:00100000:1.0:1788664307.030690:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 260 00000100:00100000:1.0:1788664307.030701:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:9975:x1875550204353152:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664307.030958:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:9975:x1875550204353152:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 259us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664307.030967:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 260 00000100:00100000:2.0:1788664307.043693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664307.046151:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353280 00000100:00100000:1.0:1788664307.046167:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353280 00000100:00100000:1.0:1788664307.046263:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 261 00000100:00100000:1.0:1788664307.046273:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:9975:x1875550204353280:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664307.046554:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:9975:x1875550204353280:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 281us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664307.046562:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 261 10000000:01000000:2.0:1788664307.103454:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788664307.103461:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68c343c800 from 7 10000000:01000000:2.0:1788664307.103465:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788664307.103507:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664307.103515:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664307.103524:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664307.103543:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222213376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664307.103620:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664307.103699:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.103778:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222213376 00000100:00100000:0.0:1788664307.103786:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222213376 00000100:00100000:0.0:1788664307.103845:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788664307.103855:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:5852:x1875550222213376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664307.103878:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664307.103893:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee400/0x762f55027be903bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be903b8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664307.103918:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee400/0x762f55027be903bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be903b8 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664307.103929:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ee400/0x762f55027be903bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be903b8 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664307.103944:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee400, rc 0) 00000100:00100000:0.0:1788664307.104000:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222213376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.104007:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788664307.104158:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222213376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664307.104173:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664307.104181:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664307.104235:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222213504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.104262:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664307.104284:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c53576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.104392:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222213504 00000100:00100000:0.0:1788664307.104397:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222213504 00000100:00100000:0.0:1788664307.104426:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788664307.104433:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222213504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664307.104713:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222213504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.104721:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788664307.104810:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222213504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664307.104852:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222213632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664307.104891:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664307.104918:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9ca0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.105013:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222213632 00000100:00100000:0.0:1788664307.105018:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222213632 00000100:00100000:0.0:1788664307.105036:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788664307.105042:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222213632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664307.105195:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222213632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.105210:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788664307.105336:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222213632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664307.108273:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11691:1875550222213760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664307.108644:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664307.108741:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9ca0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.108791:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222213760 00000100:00100000:0.0:1788664307.108799:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222213760 00000100:00100000:0.0:1788664307.110960:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788664307.110976:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:11691:x1875550222213760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664307.111674:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:11691:x1875550222213760:12345-0@lo:502:llog_process_th.0 Request processed in 700us (3028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.111682:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788664307.111984:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11691:1875550222213760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664307.112030:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664307.112049:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664307.112052:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788664307.112059:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b68c343c800 00000020:00000080:3.0:1788664307.112061:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788664307.112200:0:11691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11691:1875550222213888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664307.112245:0:11691:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664307.112286:0:11691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9ca0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664307.112405:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222213888 00000100:00100000:2.0:1788664307.112412:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222213888 00000100:00100000:2.0:1788664307.112456:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788664307.112463:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:11691:x1875550222213888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664307.112615:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:11691:x1875550222213888:12345-0@lo:502:llog_process_th.0 Request processed in 152us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664307.112622:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788664307.113281:0:11691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11691:1875550222213888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664307.113309:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664307.113315:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664307.113317:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788664307.113321:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788664307.113534:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788664307.113556:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664307.113566:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664307.113577:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664307.113586:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788664307.113589:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68f8b62000 from 7 10000000:01000000:2.0:1788664307.113592:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788664307.113620:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664307.113629:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664307.113638:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664307.113654:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664307.113714:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664307.113749:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664307.115149:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214016 00000100:00100000:3.0:1788664307.115161:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214016 00000100:00100000:3.0:1788664307.115226:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788664307.115236:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:5852:x1875550222214016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664307.115263:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664307.115281:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c147b800/0x762f55027be903cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be903c6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664307.115308:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c147b800/0x762f55027be903cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be903c6 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664307.115321:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c147b800/0x762f55027be903cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be903c6 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664307.115330:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b800, rc 0) 00000100:00100000:3.0:1788664307.115416:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222214016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664307.115422:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788664307.115476:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664307.115492:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664307.115502:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664307.115562:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664307.115605:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664307.115621:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9ca0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664307.115633:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214144 00000100:00100000:3.0:1788664307.115636:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214144 00000100:00100000:3.0:1788664307.115656:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788664307.115673:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222214144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664307.117550:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222214144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1868us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664307.117562:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788664307.133409:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664307.134034:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664307.134108:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664307.134160:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664307.134261:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214272 00000100:00100000:1.0:1788664307.134268:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214272 00000100:00100000:1.0:1788664307.134319:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788664307.134329:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222214272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.134547:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222214272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664307.134555:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788664307.136379:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664307.136779:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11693:1875550222214400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664307.136979:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664307.137020:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf780 going to sleep for 11 seconds 00000100:00100000:1.0:1788664307.137109:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214400 00000100:00100000:1.0:1788664307.137116:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214400 00000100:00100000:1.0:1788664307.137174:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788664307.137184:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:11693:x1875550222214400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664307.137416:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:11693:x1875550222214400:12345-0@lo:502:llog_process_th.0 Request processed in 233us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664307.137424:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788664307.137578:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11693:1875550222214400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664307.137604:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664307.137613:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664307.137616:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788664307.137622:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b68f8b62000 00000020:00000080:2.0:1788664307.137625:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788664307.137716:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11693:1875550222214528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664307.137754:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664307.137775:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214528 00000100:00100000:2.0:1788664307.137779:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214528 00000100:00100000:2.0:1788664307.137801:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788664307.137807:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:11693:x1875550222214528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664307.138070:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:11693:x1875550222214528:12345-0@lo:502:llog_process_th.0 Request processed in 261us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664307.138077:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788664307.138243:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788664307.138257:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11693:1875550222214528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664307.138276:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664307.138280:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664307.138282:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788664307.138286:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788664307.139944:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788664307.139975:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664307.139985:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664307.139997:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664307.140007:0:5852:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788664307.140009:0:5852:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68d438d000 from 7 10000000:01000000:1.0:1788664307.140012:0:5852:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788664307.140046:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664307.140054:0:5852:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664307.140064:0:5852:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664307.140087:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.140955:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664307.140990:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c53576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.141202:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214656 00000100:00100000:0.0:1788664307.141210:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214656 00000100:00100000:0.0:1788664307.141265:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788664307.141275:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:5852:x1875550222214656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664307.141290:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664307.141303:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66eee00/0x762f55027be903db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be903d4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664307.141327:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66eee00/0x762f55027be903db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be903d4 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664307.141338:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66eee00/0x762f55027be903db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be903d4 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664307.141365:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66eee00, rc 0) 00000100:00100000:0.0:1788664307.141400:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222214656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.141407:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788664307.141983:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664307.142003:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664307.142021:0:5852:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664307.142086:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.142372:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664307.142406:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c53576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.142956:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214784 00000100:00100000:0.0:1788664307.142973:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214784 00000100:00100000:0.0:1788664307.143019:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788664307.143028:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222214784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664307.144286:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222214784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1255us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.144298:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788664307.144401:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.144448:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.144639:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664307.144684:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c53576c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.144924:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222214912 00000100:00100000:0.0:1788664307.144930:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222214912 00000100:00100000:0.0:1788664307.144969:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788664307.144977:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222214912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664307.146010:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:5852:x1875550222214912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1030us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664307.146020:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788664307.146106:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25199117-f21d-4733-8eaf-e8fb9fef1d54:5852:1875550222214912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788664307.157507:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788664307.158410:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11695:1875550222215040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664307.158621:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664307.159076:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664307.163276:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215040 00000100:00100000:1.0:1788664307.163295:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215040 00000100:00100000:1.0:1788664307.163385:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788664307.163396:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:11695:x1875550222215040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664307.163702:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:11695:x1875550222215040:12345-0@lo:502:llog_process_th.0 Request processed in 308us (5081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664307.163710:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788664307.164050:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11695:1875550222215040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664307.164089:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664307.164099:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664307.164101:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788664307.164109:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b68d438d000 00000020:00000080:2.0:1788664307.164111:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788664307.164206:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11695:1875550222215168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664307.164273:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664307.164312:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664307.164425:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215168 00000100:00100000:0.0:1788664307.164431:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215168 00000100:00100000:0.0:1788664307.164465:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788664307.164473:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:11695:x1875550222215168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664307.164610:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:11695:x1875550222215168:12345-0@lo:502:llog_process_th.0 Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664307.164617:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788664307.164764:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25199117-f21d-4733-8eaf-e8fb9fef1d54:11695:1875550222215168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788664307.164784:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664307.164789:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664307.164791:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788664307.164794:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788664307.164956:0:5852:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788664307.164974:0:5852:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664307.164985:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664307.164996:0:5852:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664307.488052:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664308.192090:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788664308.511628:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664308.511929:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222215296:0@lo:400:kworker.0 00000100:00100000:1.0:1788664308.512011:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664308.512074:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222215808:0@lo:400:kworker.0 00000100:00100000:1.0:1788664308.512116:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664308.512140:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664308.512145:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222215680:0@lo:400:kworker.0 00000100:00100000:1.0:1788664308.512165:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664308.512595:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215296 00000100:00100000:3.0:1788664308.512604:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215296 00000100:00100000:3.0:1788664308.512662:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788664308.512672:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222215296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664308.512733:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222215296:12345-0@lo:400:kworker.0 Request processed in 62us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664308.512741:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788664308.512907:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222215424:0@lo:400:kworker.0 00000100:00100000:2.0:1788664308.512947:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664308.512977:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222215936:0@lo:400:kworker.0 00000100:00100000:2.0:1788664308.512999:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664308.513025:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664308.513030:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222215552:0@lo:400:kworker.0 00000100:00100000:2.0:1788664308.513050:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664308.513085:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215808 00000100:00100000:2.0:1788664308.513089:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215808 00000100:00100000:2.0:1788664308.513127:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215424 00000100:00100000:2.0:1788664308.513130:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215424 00000100:00100000:2.0:1788664308.513142:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215552 00000100:00100000:2.0:1788664308.513144:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215552 00000100:00100000:2.0:1788664308.513160:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788664308.513166:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222215808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664308.513388:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215680 00000100:00100000:3.0:1788664308.513393:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215680 00000100:00100000:3.0:1788664308.513424:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222215936 00000100:00100000:3.0:1788664308.513427:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222215936 00000100:00100000:3.0:1788664308.513449:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788664308.513456:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222215680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664308.513495:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222215680:12345-0@lo:400:kworker.0 Request processed in 40us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664308.513515:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788664308.513528:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664308.513534:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222215936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664308.513566:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222215936:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664308.513572:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664308.513591:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788664308.513598:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222215424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664308.513636:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222215424:12345-0@lo:400:kworker.0 Request processed in 39us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664308.513643:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788664308.513658:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788664308.513664:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222215552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664308.513689:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222215552:12345-0@lo:400:kworker.0 Request processed in 25us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664308.513694:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788664308.513752:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664308.513757:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664308.513760:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664308.513793:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6195f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222215552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664308.513804:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222215424:0@lo:400:kworker.0 00010000:00080000:3.0:1788664308.513815:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c6197b80 x1875550222215936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664308.513836:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222215936:0@lo:400:kworker.0 00000100:00100000:2.0:1788664308.514105:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222215808:12345-0@lo:400:kworker.0 Request processed in 939us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664308.514112:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788664308.514215:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222215680:0@lo:400:kworker.0 00000100:00100000:1.0:1788664308.514228:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6195c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222215296:0@lo:400:kworker.0 00000100:00100000:1.0:1788664308.514237:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222215808:0@lo:400:kworker.0 00000100:00100000:3.0:1788664309.023650:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664309.023676:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222216064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664309.023766:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664309.023919:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216064 00000100:00100000:1.0:1788664309.023928:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216064 00000100:00100000:1.0:1788664309.023991:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664309.024001:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222216064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664309.024042:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664309.024106:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222216064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664309.024114:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788664309.024152:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8935880 x1875550222216064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664309.024174:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222216064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788664309.535640:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664310.203614:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664310.203705:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664310.203749:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664310.203788:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664310.203832:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353536 00000100:00100000:3.0:1788664310.203845:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353536 00000100:00100000:3.0:1788664310.203925:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353792 00000100:00100000:3.0:1788664310.203930:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353792 00000100:00100000:3.0:1788664310.203958:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:3.0:1788664310.203969:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204353536:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664310.204082:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204353536:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664310.204092:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:3.0:1788664310.204112:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:3.0:1788664310.204120:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2361:x1875550204353792:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664310.204146:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2361:x1875550204353792:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664310.204152:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00080000:3.0:1788664310.204171:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664310.204545:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353408 00000100:00100000:2.0:1788664310.204552:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353408 00000100:00100000:2.0:1788664310.204588:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 278 00000100:00100000:2.0:1788664310.204595:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204353408:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664310.204631:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204353408:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 37us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664310.204649:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 278 00000100:00100000:0.0:1788664310.204740:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353664 00000100:00100000:0.0:1788664310.204745:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353664 00000100:00100000:0.0:1788664310.204794:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:0.0:1788664310.204802:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204353664:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664310.204833:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204353664:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 31us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664310.204839:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00080000:2.0:1788664310.205515:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788664310.559697:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664311.583686:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664312.096578:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664312.096607:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222216192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664312.096684:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664312.097038:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216192 00000100:00100000:1.0:1788664312.097047:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216192 00000100:00100000:1.0:1788664312.097122:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664312.097133:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222216192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664312.097173:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664312.097221:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222216192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664312.097255:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788664312.097310:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222216192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664312.097409:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664312.608595:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664313.631652:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222216576:0@lo:400:kworker.0 00000100:00100000:0.0:1788664313.631730:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222216704:0@lo:400:kworker.0 00000100:00100000:3.0:1788664313.631746:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664313.631817:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222216320:0@lo:400:kworker.0 00000100:00100000:2.0:1788664313.631918:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222216448:0@lo:400:kworker.0 00000100:00100000:0.0:1788664313.637534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664313.638171:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216704 00000100:00100000:0.0:1788664313.638181:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216704 00000100:00100000:0.0:1788664313.638229:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664313.638240:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222216704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664313.638318:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222216704:12345-0@lo:400:kworker.0 Request processed in 80us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664313.638325:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664313.638397:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222216704:0@lo:400:kworker.0 00000100:00100000:0.0:1788664313.638459:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216576 00000100:00100000:0.0:1788664313.638463:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216576 00000100:00100000:0.0:1788664313.638498:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788664313.638504:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222216576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664313.639074:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222216576:12345-0@lo:400:kworker.0 Request processed in 567us (7327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664313.639081:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788664313.639119:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664313.640060:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664313.640127:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222216832:0@lo:400:kworker.0 00000100:00100000:1.0:1788664313.640172:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664313.640224:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216832 00000100:00100000:1.0:1788664313.640231:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216832 00000100:00100000:1.0:1788664313.640286:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788664313.640295:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222216832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664313.640297:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216320 00000100:00100000:0.0:1788664313.640304:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216320 00000100:00100000:0.0:1788664313.640358:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788664313.640366:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222216320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664313.640377:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222216832:12345-0@lo:400:kworker.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664313.640385:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788664313.640403:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222216320:12345-0@lo:400:kworker.0 Request processed in 38us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664313.640408:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:1.0:1788664313.640429:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664313.640463:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222216320:0@lo:400:kworker.0 00000100:00100000:1.0:1788664313.640477:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222216832:0@lo:400:kworker.0 00000100:00100000:3.0:1788664313.643565:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6194e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222216576:0@lo:400:kworker.0 00000100:00100000:2.0:1788664313.643690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664313.643774:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222216960:0@lo:400:kworker.0 00000100:00100000:2.0:1788664313.643815:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664313.643893:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664313.643971:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216960 00000100:00100000:3.0:1788664313.643979:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216960 00000100:00100000:3.0:1788664313.644059:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788664313.644069:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222216960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664313.644129:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222216960:12345-0@lo:400:kworker.0 Request processed in 61us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664313.644137:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788664313.644220:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c6194380 x1875550222216960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664313.644231:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222216960:0@lo:400:kworker.0 00000100:00080000:1.0:1788664313.644312:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664313.644369:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222216448 00000100:00100000:0.0:1788664313.644376:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222216448 00000100:00100000:0.0:1788664313.644459:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788664313.644468:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222216448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664313.644527:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222216448:12345-0@lo:400:kworker.0 Request processed in 61us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664313.644534:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788664313.644589:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222216448:0@lo:400:kworker.0 00000100:00100000:3.0:1788664314.143746:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222217088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664314.143837:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664314.144035:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217088 00000100:00100000:1.0:1788664314.144044:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217088 00000100:00100000:1.0:1788664314.144117:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788664314.144139:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222217088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664314.144183:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664314.144897:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222217088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 758us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664314.145010:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788664314.145084:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8935f80 x1875550222217088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664314.145108:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222217088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788664314.655599:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664315.321335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664315.321416:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664315.321457:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664315.321494:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664315.321523:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354048 00000100:00100000:3.0:1788664315.321544:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354048 00000100:00100000:3.0:1788664315.321738:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354304 00000100:00100000:3.0:1788664315.321742:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354304 00000100:00100000:3.0:1788664315.321771:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:3.0:1788664315.321781:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2360:x1875550204354048:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664315.321861:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2360:x1875550204354048:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 81us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664315.321869:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:3.0:1788664315.321888:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:3.0:1788664315.321895:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204354304:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664315.321920:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204354304:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664315.321926:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00080000:3.0:1788664315.321945:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664315.322195:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354176 00000100:00100000:2.0:1788664315.322202:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354176 00000100:00100000:2.0:1788664315.322249:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:2.0:1788664315.322257:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204354176:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664315.322291:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204354176:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 36us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664315.322298:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:0.0:1788664315.322389:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204353920 00000100:00100000:0.0:1788664315.322393:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204353920 00000100:00100000:0.0:1788664315.322433:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 280 00000100:00100000:0.0:1788664315.322440:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204353920:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664315.322470:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204353920:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 31us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664315.322477:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 280 00000100:00080000:3.0:1788664315.323240:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664315.679798:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664316.704273:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664317.216811:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222217216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664317.216906:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664317.218141:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217216 00000100:00100000:2.0:1788664317.218152:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217216 00000100:00100000:2.0:1788664317.218267:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788664317.218279:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222217216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664317.218337:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664317.218443:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222217216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664317.218451:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788664317.218575:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664317.219056:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222217216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788664317.728066:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664318.436381:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788664318.751699:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222217600:0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.751777:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664318.751787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222217344:0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.751842:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788664318.751848:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664318.751852:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222217472:0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.751879:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664318.751894:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222217856:0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.751902:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222217984:0@lo:400:kworker.0 00000100:00100000:1.0:1788664318.751931:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664318.751938:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664318.751953:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664318.751961:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222217728:0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.751979:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217600 00000100:00100000:3.0:1788664318.751988:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217600 00000100:00100000:1.0:1788664318.751989:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664318.752051:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217984 00000100:00100000:1.0:1788664318.752056:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217984 00000100:00100000:3.0:1788664318.752058:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217472 00000100:00100000:3.0:1788664318.752063:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217472 00000100:00100000:3.0:1788664318.752090:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217856 00000100:00100000:3.0:1788664318.752093:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217856 00000100:00100000:1.0:1788664318.752096:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217728 00000100:00100000:1.0:1788664318.752101:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217728 00000100:00100000:3.0:1788664318.752118:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788664318.752130:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222217600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664318.752132:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664318.752145:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222217984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.752198:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222217600:12345-0@lo:400:kworker.0 Request processed in 70us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664318.752207:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788664318.752215:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222217984:12345-0@lo:400:kworker.0 Request processed in 61us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664318.752223:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788664318.752233:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788664318.752243:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788664318.752245:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222217472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664318.752257:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222217728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.752283:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222217472:12345-0@lo:400:kworker.0 Request processed in 42us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664318.752290:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788664318.752304:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788664318.752312:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222217856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664318.752318:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222217728:12345-0@lo:400:kworker.0 Request processed in 64us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664318.752326:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788664318.752385:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222217856:12345-0@lo:400:kworker.0 Request processed in 73us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664318.752400:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788664318.752404:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222217728:0@lo:400:kworker.0 00000100:00080000:3.0:1788664318.752421:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664318.752428:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664318.752435:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222217856:0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.752451:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222217472:0@lo:400:kworker.0 00010000:00080000:3.0:1788664318.752478:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c12ab800 x1875550222217984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664318.752489:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222217984:0@lo:400:kworker.0 00000100:00100000:3.0:1788664318.752499:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222217600:0@lo:400:kworker.0 00000100:00100000:0.0:1788664318.752576:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222217344 00000100:00100000:0.0:1788664318.752581:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222217344 00000100:00100000:0.0:1788664318.752615:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788664318.752621:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222217344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664318.752667:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222217344:12345-0@lo:400:kworker.0 Request processed in 46us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664318.752673:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788664318.752834:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222217344:0@lo:400:kworker.0 00010000:00010000:0.0:1788664318.753142:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664319.263652:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222218112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664319.263740:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664319.269438:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222218112 00000100:00100000:0.0:1788664319.269455:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222218112 00000100:00100000:0.0:1788664319.269532:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788664319.269543:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222218112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664319.269583:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664319.269674:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222218112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (5933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664319.269681:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788664319.269999:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8936680 x1875550222218112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664319.270025:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222218112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788664319.775571:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664320.439833:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664320.439890:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664320.440066:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354560 00000100:00100000:1.0:1788664320.440079:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354560 00000100:00100000:1.0:1788664320.440186:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:1.0:1788664320.440212:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204354560:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664320.440293:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204354560:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 84us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664320.440302:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00080000:3.0:1788664320.440828:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664320.441391:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354432 00000100:00100000:2.0:1788664320.441401:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354432 00000100:00100000:2.0:1788664320.441468:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 282 00000100:00100000:2.0:1788664320.441477:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204354432:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664320.441548:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204354432:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 72us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664320.441555:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 282 00000100:00100000:3.0:1788664320.459853:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664320.459908:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664320.460030:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354816 00000100:00100000:0.0:1788664320.460042:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354816 00000100:00100000:0.0:1788664320.460147:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:0.0:1788664320.460167:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204354816:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664320.460266:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204354816:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 108us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664320.460274:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:1.0:1788664320.460930:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354688 00000100:00100000:1.0:1788664320.460938:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354688 00000100:00100000:1.0:1788664320.460991:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788664320.461000:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2357:x1875550204354688:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:1.0:1788664320.461024:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90317 00000100:00080000:1.0:1788664320.461033:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b68d1aa4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788664320.461077:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788664320.461812:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+2:2357:x1875550204354688:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 809us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664320.461820:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00010000:00010000:1.0:1788664320.461842:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664320.462878:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664320.462888:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788664320.801635:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788664320.935386:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:2.0:1788664320.935397:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b68d1aa6800/5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:3.0:1788664320.935507:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68d1aa6800/5e600724-38bd-4119-be7d-5264f08f0aa5 for lustre-OST0000 00000020:00000080:3.0:1788664320.935701:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68d1aa4000 for lustre-OST0000 00010000:00010000:2.0:1788664321.823601:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664322.337723:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222218240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664322.337804:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664322.337955:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222218240 00000100:00100000:2.0:1788664322.337963:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222218240 00000100:00100000:2.0:1788664322.338046:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788664322.338056:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222218240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664322.338095:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664322.338147:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222218240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664322.338156:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788664322.338235:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664322.338314:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222218240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788664322.848813:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664323.872123:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222218624:0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.872230:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664323.872322:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788664323.872330:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222218496:0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.872379:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664323.872395:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222219008:0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.872418:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664323.872455:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222218624 00000100:00100000:3.0:1788664323.872463:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222218624 00000100:00100000:3.0:1788664323.872520:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222218496 00000100:00100000:3.0:1788664323.872523:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222218496 00000100:00100000:3.0:1788664323.872543:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788664323.872552:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222218624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.872659:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222218624:12345-0@lo:400:kworker.0 Request processed in 107us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664323.872667:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788664323.872687:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788664323.872693:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222218496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.872719:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222218496:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664323.872725:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788664323.872745:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664323.872792:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222218496:0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.872802:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788664323.872976:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222218752:0@lo:400:kworker.0 00000100:00100000:0.0:1788664323.873010:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664323.873042:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788664323.873048:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222218368:0@lo:400:kworker.0 00000100:00100000:0.0:1788664323.873079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664323.873098:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222218880:0@lo:400:kworker.0 00000100:00100000:0.0:1788664323.873116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664323.874733:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219008 00000100:00100000:3.0:1788664323.874760:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219008 00000100:00100000:3.0:1788664323.874848:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222218752 00000100:00100000:3.0:1788664323.874870:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222218752 00000100:00100000:3.0:1788664323.874899:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788664323.874909:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222219008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.874999:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222219008:12345-0@lo:400:kworker.0 Request processed in 92us (2579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664323.875005:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788664323.875023:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788664323.875029:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222218752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.875059:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222218752:12345-0@lo:400:kworker.0 Request processed in 31us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664323.875064:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788664323.875084:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222218368 00000100:00100000:3.0:1788664323.875088:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222218368 00000100:00100000:3.0:1788664323.875108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788664323.875114:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222218368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.875142:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222218368:12345-0@lo:400:kworker.0 Request processed in 29us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664323.875149:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788664323.875180:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222218880 00000100:00100000:3.0:1788664323.875184:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222218880 00000100:00100000:3.0:1788664323.875210:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788664323.875218:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222218880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664323.875248:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222218880:12345-0@lo:400:kworker.0 Request processed in 31us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664323.875253:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:3.0:1788664323.875290:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c12a8000 x1875550222219008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664323.875316:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222219008:0@lo:400:kworker.0 00000100:00080000:0.0:1788664323.875518:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664323.875523:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664323.875549:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222218368:0@lo:400:kworker.0 00000100:00100000:0.0:1788664323.875561:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222218880:0@lo:400:kworker.0 00000100:00100000:0.0:1788664323.875572:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222218752:0@lo:400:kworker.0 00010000:00010000:0.0:1788664323.875979:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664324.386049:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664324.386074:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222219136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664324.386139:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664324.386357:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219136 00000100:00100000:0.0:1788664324.386365:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219136 00000100:00100000:0.0:1788664324.386409:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788664324.386416:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222219136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664324.386445:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788664324.386606:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68f8f1d180 x1875550222219136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664324.386623:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222219136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664324.386691:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222219136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 274us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664324.386699:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:2.0:1788664324.896208:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664325.559450:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664325.559495:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664325.559534:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664325.559741:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204355200 00000100:00100000:1.0:1788664325.559755:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204355200 00000100:00100000:1.0:1788664325.559890:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204355072 00000100:00100000:1.0:1788664325.559896:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204355072 00000100:00100000:1.0:1788664325.559930:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:1.0:1788664325.559944:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204355200:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664325.560069:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2360:x1875550204355200:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 129us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664325.560078:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:1.0:1788664325.560094:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:1.0:1788664325.560101:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2360:x1875550204355072:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664325.560129:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2360:x1875550204355072:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664325.560135:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00080000:3.0:1788664325.560747:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664325.560992:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204354944 00000100:00100000:0.0:1788664325.561001:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204354944 00000100:00100000:0.0:1788664325.561049:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 284 00000100:00100000:0.0:1788664325.561067:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2360:x1875550204354944:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664325.561120:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2360:x1875550204354944:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 54us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664325.561128:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 284 00010000:00010000:2.0:1788664325.920048:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664326.945716:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664327.457424:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664327.457449:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222219264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664327.457519:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664327.457603:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219264 00000100:00100000:3.0:1788664327.457611:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219264 00000100:00100000:3.0:1788664327.457667:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788664327.457677:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222219264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664327.457714:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664327.457758:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222219264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664327.457766:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788664327.457787:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664327.457823:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222219264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664327.967642:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664328.672995:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788664328.992543:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664328.993067:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222219392:0@lo:400:kworker.0 00000100:00100000:3.0:1788664328.993150:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664328.993263:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219392 00000100:00100000:2.0:1788664328.993271:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219392 00000100:00100000:2.0:1788664328.993319:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788664328.993328:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222219392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.004423:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222219392:12345-0@lo:400:kworker.0 Request processed in 11082us (11259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.004443:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788664329.004540:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222219776:0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.004599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664329.004678:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219776 00000100:00100000:2.0:1788664329.004686:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219776 00000100:00100000:2.0:1788664329.004738:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664329.004748:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222219776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.004798:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222219776:12345-0@lo:400:kworker.0 Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.004804:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664329.004852:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6196a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222219776:0@lo:400:kworker.0 00000100:00080000:2.0:1788664329.005306:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664329.005327:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222219520:0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.005407:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664329.005435:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664329.005441:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222219648:0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.005462:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664329.005502:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219520 00000100:00100000:2.0:1788664329.005506:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219520 00000100:00100000:2.0:1788664329.005530:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219648 00000100:00100000:2.0:1788664329.005533:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219648 00000100:00100000:2.0:1788664329.005555:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788664329.005562:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222219520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.005601:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222219520:12345-0@lo:400:kworker.0 Request processed in 39us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.005607:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788664329.005621:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788664329.005627:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222219648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.005652:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222219648:12345-0@lo:400:kworker.0 Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664329.005657:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788664329.005678:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664329.005694:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6194380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222219648:0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.005704:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222219520:0@lo:400:kworker.0 00000100:00100000:1.0:1788664329.006027:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222220032:0@lo:400:kworker.0 00000100:00100000:1.0:1788664329.006056:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664329.006085:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222220032 00000100:00100000:1.0:1788664329.006089:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222220032 00000100:00100000:1.0:1788664329.006122:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788664329.006129:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222220032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664329.006179:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222220032:12345-0@lo:400:kworker.0 Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664329.006185:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788664329.006212:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788664329.006230:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c6197100 x1875550222220032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788664345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664329.006241:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222220032:0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.006991:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664329.007005:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222219904:0@lo:400:kworker.0 00000100:00100000:2.0:1788664329.007044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664329.007183:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222219904 00000100:00100000:1.0:1788664329.007190:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222219904 00000100:00100000:1.0:1788664329.007537:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788664329.007545:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222219904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664329.007607:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222219904:12345-0@lo:400:kworker.0 Request processed in 63us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664329.007614:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788664329.008502:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664329.008544:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6194a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222219904:0@lo:400:kworker.0 00000100:00100000:3.0:1788664329.010034:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6195180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222219392:0@lo:400:kworker.0 00000100:00100000:1.0:1788664329.505012:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664329.505035:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222220160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664329.505105:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664329.505168:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222220160 00000100:00100000:1.0:1788664329.505187:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222220160 00000100:00100000:1.0:1788664329.505245:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788664329.505255:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222220160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664329.505301:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664329.505368:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222220160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664329.505375:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788664329.505419:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68c6197100 x1875550222220160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664329.505439:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222220160:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788664329.767219:0:11858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:12:09 (1788664329) 00010000:00010000:1.0:1788664330.015711:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664330.682685:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664330.682727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664330.682761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664330.682914:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204355584 00000100:00100000:1.0:1788664330.682927:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204355584 00000100:00100000:1.0:1788664330.683007:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204355456 00000100:00100000:1.0:1788664330.683011:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204355456 00000100:00100000:1.0:1788664330.683033:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:1.0:1788664330.683051:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204355584:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664330.683155:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204355584:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 114us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.683163:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:1.0:1788664330.683182:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00100000:1.0:1788664330.683189:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204355456:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664330.683215:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204355456:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664330.683221:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00080000:0.0:1788664330.683648:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664330.683823:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204355328 00000100:00100000:3.0:1788664330.683830:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204355328 00000100:00100000:3.0:1788664330.683883:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 286 00000100:00100000:3.0:1788664330.683892:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204355328:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664330.683942:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204355328:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 52us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664330.683949:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 286 00010000:00010000:2.0:1788664331.039731:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664331.255862:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664331.255981:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204355712 00000100:00100000:1.0:1788664331.255991:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204355712 00000100:00100000:1.0:1788664331.256126:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:1.0:1788664331.256137:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:10243:x1875550204355712:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664331.256157:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664331.256179:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be903e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24373c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.256250:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be903e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.256264:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be903e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.256277:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be903e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664331.256313:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788664331.256317:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664331.256420:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be903e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.256449:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be903e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24373c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.256480:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be903e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24373c expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664331.256489:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68dc969800) 00010000:00010000:1.0:1788664331.256492:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664331.256496:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479400, rc 0) 00000100:00100000:1.0:1788664331.256568:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:10243:x1875550204355712:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 432us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664331.256576:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:1.0:1788664331.262526:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664331.262677:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204355840 00000100:00100000:2.0:1788664331.262690:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204355840 00000100:00100000:2.0:1788664331.262805:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:2.0:1788664331.262816:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:10244:x1875550204355840:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.262839:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664331.262858:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be903f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243743 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.262942:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.262960:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.262974:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.262993:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263001:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263008:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263261:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90405 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263270:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263285:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664331.263318:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788664331.263323:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664331.263377:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90405 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263388:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263395:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263402:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263408:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664331.263413:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263422:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263434:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68dc969800) 00010000:00010000:2.0:1788664331.263438:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.263443:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263449:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be903f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263481:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263487:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263492:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263498:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eaa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664331.263501:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263507:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263514:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b68e9afff00) 00010000:00010000:2.0:1788664331.263517:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.263520:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263525:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be903fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263557:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be903f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243743 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263571:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90405 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243743 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.263589:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b68e9aff700) 00010000:00010000:2.0:1788664331.263591:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664331.263593:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ebe00, rc 0) 00000100:00100000:2.0:1788664331.263657:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:10244:x1875550204355840:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 843us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664331.263664:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:3.0:1788664331.271755:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664331.271940:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204356096 00000100:00100000:2.0:1788664331.271951:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204356096 00000100:00100000:2.0:1788664331.272086:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:2.0:1788664331.272098:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:10244:x1875550204356096:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664331.272120:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664331.272143:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9040c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24374a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.272247:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.272262:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.272274:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.274138:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.274161:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.274187:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.274814:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebc00/0x762f55027be90421 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.274824:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebc00/0x762f55027be90421 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.274833:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebc00/0x762f55027be90421 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664331.274847:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788664331.275083:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275092:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275100:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275105:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eaa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664331.275110:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275118:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275132:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b68e9aff700) 00010000:00010000:2.0:1788664331.275135:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.275147:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275154:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90413 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275166:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275172:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275178:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275183:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664331.275186:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275313:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275322:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b68e9afff00) 00010000:00010000:2.0:1788664331.275324:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.275328:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.275334:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9041a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.276913:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9040c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24374a expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.276949:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebc00/0x762f55027be90421 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24374a expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664331.276960:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:2.0:1788664331.276963:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664331.276966:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ebc00, rc 0) 00000100:00100000:2.0:1788664331.277117:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:10244:x1875550204356096:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 5019us (5370us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788664331.277127:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:3.0:1788664331.291773:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664331.291993:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204356224 00000100:00100000:0.0:1788664331.292003:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204356224 00000100:00100000:0.0:1788664331.292081:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:0.0:1788664331.292089:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+9:10244:x1875550204356224:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788664331.292183:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+9:10244:x1875550204356224:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 Request processed in 94us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664331.292195:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000040:00080000:0.0:1788664331.744240:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788664332.064467:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664332.576112:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664332.576141:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222220288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664332.576215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664332.576315:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222220288 00000100:00100000:1.0:1788664332.576322:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222220288 00000100:00100000:1.0:1788664332.576402:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788664332.576412:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222220288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664332.576448:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664332.576509:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6195180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222220288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664332.576517:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788664332.576612:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664332.576670:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222220288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788664333.089615:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664333.269397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.270466:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204356352 00000100:00100000:3.0:1788664333.270492:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204356352 00000100:00100000:3.0:1788664333.270583:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:3.0:1788664333.270597:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+9:10286:x1875550204356352:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664333.270619:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664333.270640:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9042f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243751 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.270728:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.270745:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.270759:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.270786:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.270794:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.270813:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788664333.271090:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788664333.271319:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271328:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271334:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271405:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.271411:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271419:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271432:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68dc969800) 00010000:00010000:3.0:1788664333.271435:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.271440:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271446:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271459:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271465:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271478:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271484:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.271487:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271493:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271501:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b68c3811100) 00010000:00010000:3.0:1788664333.271504:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.271507:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271512:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be9043d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271552:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9042f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243751 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271563:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68dc969800) 00010000:00010000:3.0:1788664333.271566:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.271569:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9042f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243751 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.271578:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147ac00, rc 0) 00000100:00100000:3.0:1788664333.271693:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+9:10286:x1875550204356352:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1099us (2305us total) trans 0 rc 301/301 00000100:00100000:3.0:1788664333.271711:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:1.0:1788664333.285284:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664333.293037:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204356608 00000100:00100000:0.0:1788664333.293062:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204356608 00000100:00100000:0.0:1788664333.293171:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:0.0:1788664333.293181:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+9:10286:x1875550204356608:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:0.0:1788664333.293250:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664333.293287:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be903e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24373c expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.293323:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68dc969800) 00010000:00010000:0.0:1788664333.293370:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664333.293609:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.293625:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.293636:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.293647:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.294897:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.294969:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664333.297416:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788664333.297432:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.297441:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.297447:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.297453:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664333.297457:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.297475:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.297491:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664333.297494:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664333.297499:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.297505:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90444 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664333.297524:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bf914fb reply state 0000000057258155 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664333.297534:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664333.297646:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+10:10286:x1875550204356608:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 4462us (12367us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788664333.297668:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00010000:00010000:3.0:1788664333.299588:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.299605:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.299612:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.299618:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.299622:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.299630:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.299646:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b68e1346100) 00010000:00010000:3.0:1788664333.299661:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.299666:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.299673:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9044b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664333.382695:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664333.383259:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204356736 00000100:00100000:2.0:1788664333.383270:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204356736 00000100:00100000:2.0:1788664333.383328:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:2.0:1788664333.383359:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+9:10295:x1875550204356736:12345-192.168.202.14@tcp:101:lctl.0 00010000:00010000:2.0:1788664333.383385:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664333.383410:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.383487:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.383501:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.383513:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664333.383568:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788664333.383573:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664333.383618:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.383660:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243758 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.383679:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243758 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.383687:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:2.0:1788664333.383690:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664333.383694:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea600, rc 0) 00000100:00100000:2.0:1788664333.383769:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+10:10295:x1875550204356736:12345-192.168.202.14@tcp:101:lctl.0 Request processed in 432us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664333.383776:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:1.0:1788664333.431130:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664333.431243:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204356864 00000100:00100000:2.0:1788664333.431254:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204356864 00000100:00100000:2.0:1788664333.431331:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788664333.431395:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+10:10301:x1875550204356864:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788664333.431418:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664333.431439:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24375f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431520:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431557:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431570:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431587:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431595:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431602:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431717:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb400/0x762f55027be90475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431726:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb400/0x762f55027be90475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431733:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb400/0x762f55027be90475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664333.431775:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788664333.431779:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664333.431821:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb400/0x762f55027be90475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431833:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431850:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431856:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431862:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664333.431867:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431874:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431900:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:2.0:1788664333.431905:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664333.431911:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431918:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431934:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431940:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431946:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431951:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eba00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664333.431961:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431967:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431975:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b68e9affa00) 00010000:00010000:2.0:1788664333.431977:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664333.431981:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.431986:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9046e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.432020:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24375f expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.432035:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb400/0x762f55027be90475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24375f expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.432042:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664333.432045:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788664333.432047:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb400, rc 0) 00000100:00100000:2.0:1788664333.432118:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10301:x1875550204356864:12345-192.168.202.14@tcp:101:bash.0 Request processed in 778us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664333.432125:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788664333.437087:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.437178:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204357120 00000100:00100000:3.0:1788664333.437189:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204357120 00000100:00100000:3.0:1788664333.437251:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:3.0:1788664333.437261:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10301:x1875550204357120:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788664333.437296:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664333.437317:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9047c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243766 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.437504:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.437519:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.437530:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.437582:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.437590:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.437598:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788664333.438167:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788664333.438367:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438377:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438386:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438437:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438445:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438452:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438458:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.438461:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438469:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438482:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664333.438486:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.438490:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438498:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90483 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664333.438511:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5cbb299 reply state 000000006aa4db9a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664333.438520:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788664333.438553:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9047c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438579:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.438587:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664333.438589:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664333.438592:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a600, rc 0) 00000100:00100000:3.0:1788664333.438668:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10301:x1875550204357120:12345-192.168.202.14@tcp:101:bash.0 Request processed in 1408us (1593us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788664333.438676:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00010000:00010000:0.0:1788664333.444486:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.444506:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.444514:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.444522:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664333.444528:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.444561:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.444581:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811100) 00010000:00010000:0.0:1788664333.444585:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664333.444590:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.444596:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9048a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664333.447529:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.447712:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204357248 00000100:00100000:3.0:1788664333.447721:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204357248 00000100:00100000:3.0:1788664333.447811:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:3.0:1788664333.447819:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875550204357248:12345-192.168.202.14@tcp:8:bash.0 00010000:00080000:3.0:1788664333.447855:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:3.0:1788664333.447898:0:6694:0:(genops.c:1385:class_connect()) connect: client 5e600724-38bd-4119-be7d-5264f08f0aa5, cookie 0x762f55027be9049f 00002000:00100000:3.0:1788664333.447910:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5e600724-38bd-4119-be7d-5264f08f0aa5/ffff9b68c91c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788664333.447934:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b6, return b6 00002000:00080000:3.0:1788664333.448167:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788664333.448201:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b68c91cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664333.448266:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2357:x1875550204357248:12345-192.168.202.14@tcp:8:bash.0 Request processed in 445us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664333.448273:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:3.0:1788664333.452840:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664333.454047:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204357376 00000100:00100000:1.0:1788664333.454060:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204357376 00000100:00100000:1.0:1788664333.454188:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788664333.454199:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:0:x1875550204357376:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788664333.454218:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664333.454240:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24376d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664333.454267:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664333.454285:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788664333.454289:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664333.454298:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.454329:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.454361:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478600, rc 0) 00000100:00100000:1.0:1788664333.454431:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:0:x1875550204357376:12345-192.168.202.14@tcp:101:bash.0 Request processed in 234us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664333.454439:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788664333.459294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664333.459382:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204357504 00000100:00100000:2.0:1788664333.459390:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204357504 00000100:00100000:2.0:1788664333.459449:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:2.0:1788664333.459457:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:10301:x1875550204357504:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788664333.459473:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664333.459492:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243774 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.459516:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.459523:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664333.459526:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664333.459530:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.459571:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 8 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.459581:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 8 pid: 6697 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664333.459591:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1464380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875550222220416:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664333.459688:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d415b180 going to sleep for 11 seconds 00000100:00080000:0.0:1788664333.460422:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664333.463877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664333.464088:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204357632 00000100:00100000:0.0:1788664333.464100:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204357632 00010000:00010000:0.0:1788664333.464145:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 9 pid: 6697 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664333.464247:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:0.0:1788664333.464258:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2361:x1875550204357632:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664333.464275:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664333.464299:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 9 pid: 6697 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.464314:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 9 pid: 6697 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.464377:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664333.464388:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664333.464397:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.464408:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.464444:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664333.464457:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9023480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5841:1875550222220544:192.168.202.14@tcp:105: 00000100:00100000:0.0:1788664333.464539:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea000 going to sleep for 11 seconds 00010000:00010000:2.0:1788664333.467695:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24376d expref: 9 pid: 6697 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664333.467724:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1464380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875550222220416:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664333.467787:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.467803:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb200, rc 0) 00000100:00100000:2.0:1788664333.467880:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:10301:x1875550204357504:12345-192.168.202.14@tcp:101:bash.0 Request processed in 8422us (8596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664333.467890:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:3.0:1788664333.475172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664333.475182:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9023480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5841:1875550222220544:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788664333.475210:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664333.475259:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204357888 00000100:00100000:2.0:1788664333.475267:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204357888 00000100:00100000:0.0:1788664333.475274:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204357632:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 11018us (11408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664333.475284:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788664333.475326:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788664333.475336:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10301:x1875550204357888:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:2.0:1788664333.475712:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10301:x1875550204357888:12345-192.168.202.14@tcp:35:bash.0 Request processed in 379us (550us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788664333.475717:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:1.0:1788664333.551306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664333.551713:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204358144 00000100:00100000:2.0:1788664333.551737:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204358144 00000100:00100000:2.0:1788664333.551818:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:2.0:1788664333.551830:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10311:x1875550204358144:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664333.551997:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664333.552020:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be904b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24377b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664333.552305:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788664333.552887:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be904b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24377b expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.552905:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:3.0:1788664333.552908:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664333.552914:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be904b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24377b expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.553022:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eba00, rc 0) 00000100:00100000:3.0:1788664333.553107:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10311:x1875550204358144:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1279us (1812us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788664333.553115:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:3.0:1788664333.556521:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664333.556652:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204358400 00000100:00100000:1.0:1788664333.556663:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204358400 00000100:00100000:1.0:1788664333.556740:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788664333.556752:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10311:x1875550204358400:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788664333.557093:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10311:x1875550204358400:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 342us (581us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788664333.557102:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788664333.630005:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.630102:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204358528 00000100:00100000:3.0:1788664333.630114:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204358528 00000100:00100000:3.0:1788664333.630197:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:3.0:1788664333.630205:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10317:x1875550204358528:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664333.630229:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664333.630247:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be904c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243782 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.630306:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be904c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.630318:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be904c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.630327:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be904c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664333.630454:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788664333.630456:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664333.630473:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be904c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.630501:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be904c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243782 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.630521:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be904c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243782 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.630529:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664333.630531:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664333.630534:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a200, rc 0) 00000100:00100000:3.0:1788664333.630589:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10317:x1875550204358528:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 384us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664333.630596:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:2.0:1788664333.634736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664333.634862:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204358784 00000100:00100000:0.0:1788664333.634873:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204358784 00000100:00100000:0.0:1788664333.634933:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:0.0:1788664333.634944:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10317:x1875550204358784:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664333.634966:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664333.634986:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be904d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243789 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.635111:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be904d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.635142:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be904d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.635155:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be904d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664333.635171:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788664333.635312:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be904d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243789 expref: 20 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.635333:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be904d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243789 expref: 19 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.635385:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:0.0:1788664333.635388:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664333.635392:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef400, rc 0) 00000100:00100000:0.0:1788664333.635542:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+19:10317:x1875550204358784:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 599us (815us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788664333.635550:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:1.0:1788664333.638438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664333.638532:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204358912 00000100:00100000:0.0:1788664333.638541:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204358912 00000100:00100000:0.0:1788664333.638598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:0.0:1788664333.638607:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2361:x1875550204358912:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664333.638634:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664333.638658:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be904d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243789 expref: 19 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.638693:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:0.0:1788664333.638698:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664333.638760:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+18:2361:x1875550204358912:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 153us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664333.638767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:2.0:1788664333.640416:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.640647:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204359168 00000100:00100000:3.0:1788664333.640656:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204359168 00000100:00100000:3.0:1788664333.640708:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:3.0:1788664333.640729:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+18:10317:x1875550204359168:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664333.640759:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664333.640778:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be904e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243790 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.641040:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be904ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.641073:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be904ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.641087:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be904ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664333.641103:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788664333.641246:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be904e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243790 expref: 21 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.641263:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be904ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243790 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.641272:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664333.641275:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788664333.641279:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b200, rc 0) 00000100:00100000:3.0:1788664333.641494:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+20:10317:x1875550204359168:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 767us (1082us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788664333.641501:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:2.0:1788664333.646664:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664333.647074:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204359296 00000100:00100000:1.0:1788664333.647085:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204359296 00000100:00100000:1.0:1788664333.647236:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:1.0:1788664333.647248:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204359296:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:1.0:1788664333.647296:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.647320:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.647330:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664333.647335:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664333.647383:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.647434:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.647465:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664333.647480:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875550222220672:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664333.647581:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c581b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664333.651752:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875550222220672:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664333.651785:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664333.654442:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664333.654595:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204359424 00000100:00100000:0.0:1788664333.654616:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204359424 00002000:00100000:0.0:1788664333.654677:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b68f8cefb80 x1875550204359424/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:639/0 lens 504/0 e 0 to 0 dl 1788664344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788664333.654688:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8cefb80 with x1875550204359424 ext(0->12) 00010000:00010000:0.0:1788664333.654699:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 8 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.654728:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 8 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664333.654736:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68f8cefb80 00000100:00100000:0.0:1788664333.654771:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788664333.654782:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204359424:12345-192.168.202.14@tcp:4:lfs.0 00000001:00100000:2.0:1788664333.705334:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000001:00080000:0.0:1788664333.779046:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788664333.779238:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204359424:12345-192.168.202.14@tcp:4:lfs.0 Request processed in 124450us (124798us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788664333.779257:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00002000:00100000:1.0:1788664333.779274:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9b68f8cefb80 x1875550204359424/t4294967299(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:639/0 lens 504/448 e 0 to 0 dl 1788664344 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664333.779285:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8cefb80 with x1875550204359424 ext(0->12) 00010000:00010000:1.0:1788664333.779296:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.779316:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664333.779324:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68f8cefb80 00000100:00100000:0.0:1788664333.792393:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664333.792456:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204359552 00000100:00100000:1.0:1788664333.792467:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204359552 00010000:00010000:1.0:1788664333.792509:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664333.792605:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:1.0:1788664333.792616:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204359552:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664333.792632:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788664333.792651:0:7644:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788664333.792654:0:7644:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788664334 00002000:00010000:1.0:1788664333.792656:0:7644:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788664334 00002000:00010000:1.0:1788664333.792658:0:7644:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788664334 00002000:00010000:1.0:1788664333.792660:0:7644:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788664333.792666:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.792679:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.792714:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be904ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243774 expref: 7 pid: 6696 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.792731:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664333.792736:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664333.792742:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.792751:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.792797:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664333.792866:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204359552:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 251us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664333.792874:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00010000:00010000:3.0:1788664333.793159:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793170:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793203:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793214:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793222:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793229:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664333.793232:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793240:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793254:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.793261:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be904fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664333.793332:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2360:x1875550204359296:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 146085us (146684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664333.793380:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788664333.805248:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664333.806198:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204359808 00000100:00100000:1.0:1788664333.806218:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204359808 00000100:00100000:2.0:1788664333.806403:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788664333.806415:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+20:10317:x1875550204359808:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:2.0:1788664333.806487:0:5858:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be904ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243790 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664333.806809:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788664333.806872:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788664333.807469:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788664333.807537:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.807554:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.807563:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.807604:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664333.807621:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 24 pid: 5854 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664333.807636:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1875550222220800:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664333.807830:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e37900 going to sleep for 11 seconds 00000100:00100000:3.0:1788664333.818612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664333.818715:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204359936 00000100:00100000:1.0:1788664333.818726:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204359936 00010000:00010000:1.0:1788664333.818783:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 25 pid: 5854 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664333.818841:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:1.0:1788664333.818854:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+25:2360:x1875550204359936:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664333.818876:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664333.818885:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 25 pid: 5854 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.818901:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 25 pid: 5854 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.818926:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:1.0:1788664333.818932:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.818942:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.818971:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664333.818992:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664333.819058:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+25:2360:x1875550204359936:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 206us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664333.819065:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00010000:00010000:0.0:1788664333.820208:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243766 expref: 24 pid: 5854 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664333.820245:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5858:1875550222220800:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664333.820268:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.820279:0:5858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.820285:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664333.820609:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788664333.820833:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788664333.820976:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1875550222220928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788664333.821102:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664333.821128:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eeae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664333.821740:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222220928 00000100:00100000:1.0:1788664333.821748:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222220928 00000100:00100000:1.0:1788664333.821820:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664333.821830:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1875550222220928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788664333.821930:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5858:x1875550222220928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664333.821937:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664333.822052:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1875550222220928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788664333.823212:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788664333.823305:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f36d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1875550222221056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788664333.823406:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664333.823434:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664333.823755:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222221056 00000100:00100000:2.0:1788664333.823772:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222221056 00000100:00100000:2.0:1788664333.823816:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664333.823826:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5858:x1875550222221056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788664333.824109:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5858:x1875550222221056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 283us (702us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788664333.824116:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664333.824370:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f36d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5858:1875550222221056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788664333.824434:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788664333.824481:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.824492:0:5858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.824500:0:5858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.824506:0:5858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.824510:0:5858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.824517:0:5858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.824536:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664333.824539:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788664333.824544:0:5858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.824551:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90501 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788664333.824709:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788664333.825200:0:5858:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788664333.829053:0:5858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788664333.829080:0:5858:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367812738167ns, next at 368812733421ns, rc = 0 00000001:00080000:3.0:1788664333.829099:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788664333.829177:0:5858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664333.829183:0:5858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788664333.829196:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be904ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243790 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664333.829376:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+27:10317:x1875550204359808:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 22962us (24140us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788664333.829386:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000020:00080000:3.0:1788664333.829392:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788664333.833192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664333.833260:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204360064 00000100:00100000:0.0:1788664333.833271:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204360064 00000100:00100000:0.0:1788664333.833335:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:0.0:1788664333.833373:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+27:10317:x1875550204360064:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664333.833398:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664333.833423:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243797 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.833497:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243797 expref: 28 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.833538:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243797 expref: 28 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664333.833561:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:0.0:1788664333.833565:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664333.833568:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef400, rc 0) 00000100:00100000:0.0:1788664333.833626:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+28:10317:x1875550204360064:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 282us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664333.833632:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788664333.847835:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.847985:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204360320 00000100:00100000:3.0:1788664333.847998:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204360320 00000100:00100000:3.0:1788664333.848071:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788664333.848083:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+28:10317:x1875550204360320:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664333.848367:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+29:10317:x1875550204360320:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 285us (545us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788664333.848375:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788664333.919388:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.919503:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204360576 00000100:00100000:3.0:1788664333.919517:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204360576 00000100:00100000:3.0:1788664333.919597:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788664333.919610:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+29:10327:x1875550204360576:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664333.919639:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664333.919693:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9050f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24379e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664333.919804:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788664333.919941:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9050f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24379e expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.919957:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:3.0:1788664333.919960:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664333.919966:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9050f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24379e expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.919979:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b200, rc 0) 00000100:00100000:3.0:1788664333.920053:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+30:10327:x1875550204360576:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 442us (710us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788664333.920061:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:2.0:1788664333.923617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.923705:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204360704 00000100:00100000:3.0:1788664333.923716:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204360704 00000100:00100000:3.0:1788664333.923782:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:3.0:1788664333.923793:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+30:10327:x1875550204360704:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788664333.923895:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.923912:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.923923:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.923955:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.923962:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.923984:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924084:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924093:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924099:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664333.924151:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924165:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924171:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924178:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924184:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147ac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.924189:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924201:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924213:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664333.924216:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.924220:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924225:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9051d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924248:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924254:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924259:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924265:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.924267:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924272:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924278:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811d00) 00010000:00010000:3.0:1788664333.924280:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.924282:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924297:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924313:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924318:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924322:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924326:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664333.924328:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924333:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924380:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664333.924383:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664333.924386:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664333.924391:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9052b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664333.924466:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+30:10327:x1875550204360704:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 675us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664333.924474:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:0.0:1788664333.931079:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664333.931480:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204360960 00000100:00100000:3.0:1788664333.931490:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204360960 00000100:00100000:3.0:1788664333.931548:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788664333.931559:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+30:10327:x1875550204360960:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664333.931983:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:10327:x1875550204360960:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 425us (911us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788664333.931991:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788664334.002327:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.003449:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204361216 00000100:00100000:3.0:1788664334.003463:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204361216 00000100:00100000:3.0:1788664334.003550:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:3.0:1788664334.003562:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:10330:x1875550204361216:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664334.003591:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664334.003615:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90532 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437a5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.003806:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.003843:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.003879:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.003901:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.003916:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.003938:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004080:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004089:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004094:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664334.004104:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788664334.004306:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004312:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004324:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004329:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664334.004332:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004337:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004406:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664334.004417:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664334.004428:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004433:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004456:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004460:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004464:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004467:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147ac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664334.004469:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004498:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004506:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811d00) 00010000:00010000:3.0:1788664334.004508:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664334.004521:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004529:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004640:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90532 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004707:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.004747:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664334.004749:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664334.004751:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b200, rc 0) 00000100:00100000:3.0:1788664334.004875:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+33:10330:x1875550204361216:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1315us (2559us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788664334.004883:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:2.0:1788664334.010337:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.010464:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204361344 00000100:00100000:3.0:1788664334.010475:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204361344 00000100:00100000:3.0:1788664334.010539:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:3.0:1788664334.010550:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+33:10330:x1875550204361344:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:3.0:1788664334.010630:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010647:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010671:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010705:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010712:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010738:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010745:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664334.010753:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010761:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010774:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664334.010777:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664334.010782:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.010792:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664334.010919:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+33:10330:x1875550204361344:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 371us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664334.010927:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788664334.017020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.017091:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204361600 00000100:00100000:3.0:1788664334.017099:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204361600 00000100:00100000:3.0:1788664334.017144:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788664334.017153:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+33:10330:x1875550204361600:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664334.017431:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+34:10330:x1875550204361600:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 280us (422us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788664334.017437:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:2.0:1788664334.111759:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222221440:0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.111844:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664334.111919:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664334.111927:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222221312:0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.111965:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664334.111984:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222221824:0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.112013:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664334.112085:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664334.112098:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222221440 00000100:00100000:2.0:1788664334.112106:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222221440 00000100:00100000:2.0:1788664334.112157:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222221312 00000100:00100000:2.0:1788664334.112160:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222221312 00000100:00100000:2.0:1788664334.112186:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788664334.112195:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222221440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.112263:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875550222221440:12345-0@lo:400:kworker.0 Request processed in 68us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664334.112297:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788664334.112316:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788664334.112322:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222221312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.112376:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222221312:12345-0@lo:400:kworker.0 Request processed in 54us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664334.112381:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1788664334.112398:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664334.112428:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222221312:0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.112438:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3310:1875550222221440:0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.112527:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222221184:0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.112563:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664334.112594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222221696:0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.112617:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664334.112636:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664334.112642:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222221568:0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.112684:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664334.112712:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222221824 00000100:00100000:1.0:1788664334.112716:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222221824 00000100:00100000:1.0:1788664334.112746:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222221568 00000100:00100000:1.0:1788664334.112750:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222221568 00000100:00100000:1.0:1788664334.112775:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788664334.112783:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222221824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.112832:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222221824:12345-0@lo:400:kworker.0 Request processed in 49us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664334.112838:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788664334.112851:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788664334.112858:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222221568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.112888:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222221568:12345-0@lo:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664334.112893:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788664334.112910:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664334.112928:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222221568:0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.112944:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222221696 00000100:00100000:1.0:1788664334.112947:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222221696 00000100:00100000:1.0:1788664334.112973:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788664334.112978:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222221696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.113008:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875550222221696:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664334.113014:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788664334.113027:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664334.113058:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222221696:0@lo:400:kworker.0 00000100:00100000:1.0:1788664334.113080:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222221824:0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.115142:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222221184 00000100:00100000:2.0:1788664334.115155:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222221184 00000100:00100000:2.0:1788664334.115287:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788664334.115298:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222221184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.115398:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222221184:12345-0@lo:400:kworker.0 Request processed in 102us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664334.115405:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788664334.115709:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1467800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222221184:0@lo:400:kworker.0 00000100:00100000:2.0:1788664334.292405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.292524:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204361856 00000100:00100000:1.0:1788664334.292534:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204361856 00000100:00100000:1.0:1788664334.292601:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788664334.292613:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+34:10361:x1875550204361856:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:1.0:1788664334.292653:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664334.292698:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be9055c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437ac expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.292836:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.292854:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.292868:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664334.292880:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788664334.293226:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be9055c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437ac expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.293250:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437ac expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.293259:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:1.0:1788664334.293262:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664334.293266:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478200, rc 0) 00000100:00100000:1.0:1788664334.293441:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+36:10361:x1875550204361856:12345-192.168.202.14@tcp:101:cat.0 Request processed in 829us (1046us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788664334.293448:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:2.0:1788664334.300197:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664334.300240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.301733:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204361984 00000100:00100000:3.0:1788664334.301746:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204361984 00000100:00100000:3.0:1788664334.301819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:3.0:1788664334.301828:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5891450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+36:2361:x1875550204361984:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664334.301843:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664334.301867:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437ac expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.301888:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664334.301894:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664334.301969:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5891450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+35:2361:x1875550204361984:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 142us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664334.301976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788664334.303472:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204362240 00000100:00100000:1.0:1788664334.303483:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204362240 00000100:00100000:1.0:1788664334.303542:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:1.0:1788664334.303551:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+35:10361:x1875550204362240:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:1.0:1788664334.304860:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+36:10361:x1875550204362240:12345-192.168.202.14@tcp:35:cat.0 Request processed in 1301us (4610us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788664334.304871:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:2.0:1788664334.342143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.342229:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204362496 00000100:00100000:3.0:1788664334.342239:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204362496 00000100:00100000:3.0:1788664334.342304:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788664334.342316:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+36:10367:x1875550204362496:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:3.0:1788664334.342371:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664334.342375:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788664334.342402:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be904c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243782 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.342428:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664334.342434:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664334.342449:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90571 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437b3 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.342641:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.342654:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.342662:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.342710:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.342726:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 36 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664334.342740:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222221952:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664334.346261:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664334.350925:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f35500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222221952:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664334.350956:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664334.351236:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.351557:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204362624 00000100:00100000:1.0:1788664334.351564:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204362624 00010000:00010000:1.0:1788664334.351601:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 37 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664334.351693:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:1.0:1788664334.351707:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+37:2361:x1875550204362624:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664334.351724:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664334.351732:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 37 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.351745:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 37 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.351774:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437a5 expref: 37 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.351788:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:1.0:1788664334.351792:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.351802:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.351807:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.351850:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664334.351881:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.351888:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664334.351915:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+36:2361:x1875550204362624:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 209us (680us total) trans 0 rc 0/0 00000004:00200000:2.0:1788664334.351916:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1788664334.351922:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00010000:00010000:2.0:1788664334.352229:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90571 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 37 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.352246:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.352254:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:2.0:1788664334.352257:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664334.352259:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147ac00, rc 0) 00000100:00100000:2.0:1788664334.352297:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+36:10367:x1875550204362496:12345-192.168.202.14@tcp:101:dd.0 Request processed in 9985us (10165us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788664334.352303:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788664334.354874:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.354925:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204362880 00000100:00100000:1.0:1788664334.354932:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204362880 00000100:00100000:1.0:1788664334.354999:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:1.0:1788664334.355006:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+36:10367:x1875550204362880:12345-192.168.202.14@tcp:36:dd.0 00010000:00010000:1.0:1788664334.355306:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.355322:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.355331:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664334.355398:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788664334.355427:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d953838b reply state 0000000033357b4a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664334.355436:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664334.355540:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+39:10367:x1875550204362880:12345-192.168.202.14@tcp:36:dd.0 Request processed in 532us (672us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788664334.355548:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00000020:00080000:1.0:1788664334.355553:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788664334.362332:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.362374:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.362383:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.362390:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664334.362397:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.362429:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.362450:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664334.362453:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664334.362458:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.362464:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664334.529404:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664334.529785:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204363008 00000100:00100000:0.0:1788664334.529796:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204363008 00000100:00100000:0.0:1788664334.529855:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:0.0:1788664334.529865:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+38:10381:x1875550204363008:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:0.0:1788664334.529901:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664334.529924:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be9058d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437ba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.529997:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530365:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530379:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530397:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530404:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530410:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530507:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530518:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530526:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530562:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.530576:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 39 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664334.530614:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222222080:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664334.530773:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664334.538265:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.538375:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204363264 00000100:00100000:1.0:1788664334.538387:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204363264 00000100:00100000:3.0:1788664334.538408:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222222080:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664334.538443:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664334.538451:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:1.0:1788664334.538475:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+40:5600:x1875550204363264:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788664334.538902:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+41:5600:x1875550204363264:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 427us (645us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788664334.538910:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788664334.542081:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.542926:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204363392 00000100:00100000:3.0:1788664334.542939:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204363392 00010000:00010000:3.0:1788664334.542986:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 41 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664334.543023:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:3.0:1788664334.543033:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+41:2360:x1875550204363392:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664334.543050:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664334.543057:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 41 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.543070:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 41 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.543110:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90578 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437b3 expref: 41 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.543127:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664334.543133:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.543142:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.543150:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.543236:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664334.543301:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+40:2360:x1875550204363392:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 269us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664334.543309:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00010000:00010000:0.0:1788664334.546953:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.546972:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664334.547036:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788664334.547042:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664334.547096:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547113:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547124:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547131:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547137:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547143:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664334.547147:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547171:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547187:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664334.547190:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664334.547196:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547203:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90594 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547220:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547226:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547231:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547236:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664334.547238:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547243:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547250:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346a00) 00010000:00010000:0.0:1788664334.547252:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664334.547255:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547270:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9059b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547326:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be9058d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437ba expref: 40 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547416:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437ba expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.547424:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:0.0:1788664334.547426:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664334.547429:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efe00, rc 0) 00000100:00100000:0.0:1788664334.547875:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+39:10381:x1875550204363008:12345-192.168.202.14@tcp:101:stat.0 Request processed in 18009us (18478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664334.547884:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788664334.614746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.614859:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204363648 00000100:00100000:1.0:1788664334.614881:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204363648 00000100:00100000:1.0:1788664334.614956:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:1.0:1788664334.614966:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+39:10387:x1875550204363648:12345-192.168.202.14@tcp:36:truncate.0 00010000:00010000:1.0:1788664334.615034:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664334.615064:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be905a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437ba expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.615086:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:1.0:1788664334.615092:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664334.615719:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.615734:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.615745:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664334.615804:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788664334.615830:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000de8ad9c reply state 00000000a84d72fb transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664334.615839:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664334.616254:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+41:10387:x1875550204363648:12345-192.168.202.14@tcp:36:truncate.0 Request processed in 1287us (1528us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788664334.616263:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00000020:00080000:1.0:1788664334.616269:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788664334.621637:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.621654:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.621660:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.621665:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664334.621670:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.621677:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.621693:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:1.0:1788664334.621696:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664334.621701:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.621707:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664334.625241:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664334.625265:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222222208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664334.625373:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664334.625865:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222222208 00000100:00100000:1.0:1788664334.625884:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222222208 00000100:00100000:1.0:1788664334.625940:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788664334.625949:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222222208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664334.625990:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788664334.626242:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222222208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 293us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664334.626250:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788664334.627018:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222222208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664334.717999:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664334.718102:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204363776 00000100:00100000:0.0:1788664334.718113:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204363776 00000100:00100000:0.0:1788664334.718194:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:0.0:1788664334.718203:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+40:10401:x1875550204363776:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:0.0:1788664334.718227:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664334.718245:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be905b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437c1 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718304:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718315:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718337:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718375:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718380:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718384:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718452:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718466:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718471:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664334.718513:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788664334.718519:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664334.718538:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718547:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718554:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718583:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718590:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718600:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664334.718606:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718615:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718639:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664334.718642:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664334.718648:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718653:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718667:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718673:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718679:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718684:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664334.718693:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718698:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718705:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346a00) 00010000:00010000:0.0:1788664334.718708:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664334.718722:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718808:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718837:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be905b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 42 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718851:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.718861:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:0.0:1788664334.718864:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664334.718866:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef600, rc 0) 00000100:00100000:0.0:1788664334.718935:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+41:10401:x1875550204363776:12345-192.168.202.14@tcp:101:stat.0 Request processed in 732us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664334.718942:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:2.0:1788664334.785759:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.785831:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204364032 00000100:00100000:1.0:1788664334.785842:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204364032 00000100:00100000:1.0:1788664334.785900:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:1.0:1788664334.785912:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+41:10411:x1875550204364032:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664334.785941:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664334.785966:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be905cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437c8 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664334.786079:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788664334.786189:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be905cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c8 expref: 43 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.786202:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:1.0:1788664334.786205:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664334.786210:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be905cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c8 expref: 43 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.786230:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479400, rc 0) 00000100:00100000:1.0:1788664334.786286:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+42:10411:x1875550204364032:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 376us (538us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788664334.786295:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:1.0:1788664334.788507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664334.788595:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204364288 00000100:00100000:0.0:1788664334.788602:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204364288 00000100:00100000:0.0:1788664334.788654:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788664334.788661:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+42:10411:x1875550204364288:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788664334.788880:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+43:10411:x1875550204364288:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 218us (383us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788664334.788887:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:2.0:1788664334.833538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.833958:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204364544 00000100:00100000:3.0:1788664334.833970:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204364544 00000100:00100000:3.0:1788664334.834159:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:3.0:1788664334.834172:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+43:10417:x1875550204364544:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788664334.834198:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664334.834235:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be905da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437cf expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.834399:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.834417:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.834427:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.834485:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 44 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.834498:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 44 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664334.834513:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f34380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222222336:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664334.834628:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664334.838910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664334.839149:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204364672 00000100:00100000:0.0:1788664334.839159:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204364672 00010000:00010000:0.0:1788664334.839200:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 45 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664334.839240:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:0.0:1788664334.839250:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+45:2360:x1875550204364672:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664334.839265:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664334.839271:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 45 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.839282:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 45 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.839302:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:0.0:1788664334.839308:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.839317:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.839325:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.839364:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664334.839432:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+45:2360:x1875550204364672:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 183us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664334.839440:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00010000:00010000:3.0:1788664334.840832:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be905c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437c1 expref: 44 pid: 5856 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664334.840854:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f34380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222222336:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664334.840876:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.841066:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.841076:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664334.841121:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788664334.841312:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be905da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 45 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.841332:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.842247:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:2.0:1788664334.842253:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664334.842257:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a200, rc 0) 00000100:00100000:2.0:1788664334.842335:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+44:10417:x1875550204364544:12345-192.168.202.14@tcp:101:bash.0 Request processed in 8163us (8808us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788664334.842677:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:2.0:1788664334.845311:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.845795:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204364928 00000100:00100000:1.0:1788664334.845822:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204364928 00000100:00100000:1.0:1788664334.845916:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:1.0:1788664334.845929:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+44:10417:x1875550204364928:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:1.0:1788664334.846249:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.846266:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.846278:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664334.846325:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788664334.848094:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ec063d1 reply state 0000000079351f9d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664334.848111:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664334.848366:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10417:x1875550204364928:12345-192.168.202.14@tcp:36:bash.0 Request processed in 2436us (3064us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788664334.848376:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00000020:00080000:1.0:1788664334.848382:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664334.853723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664334.853757:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204365056 00000100:00100000:0.0:1788664334.853766:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204365056 00000100:00100000:0.0:1788664334.853816:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:0.0:1788664334.853827:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10417:x1875550204365056:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664334.853855:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664334.853877:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437d6 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.853976:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.854250:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.854258:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.854266:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.854283:0:5856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.854332:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.854385:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 48 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664334.854400:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c9337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222222464:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664334.854595:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea180 going to sleep for 11 seconds 00010000:00010000:2.0:1788664334.854691:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.854709:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.854717:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.854722:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664334.854726:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.854733:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.854756:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:2.0:1788664334.854758:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664334.854761:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.854768:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.854774:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be905ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664334.858685:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.858784:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204365184 00000100:00100000:1.0:1788664334.858794:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204365184 00010000:00010000:1.0:1788664334.858836:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 48 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664334.858874:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:1.0:1788664334.858884:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+48:2361:x1875550204365184:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664334.858925:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664334.858934:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 48 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.858952:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 48 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.858976:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:1.0:1788664334.858993:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.859004:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.859012:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664334.859032:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664334.859093:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+48:2361:x1875550204365184:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 210us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664334.859101:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00010000:00010000:2.0:1788664334.859552:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be905e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437cf expref: 47 pid: 5854 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664334.859575:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c9337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222222464:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664334.859604:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.859614:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.859620:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664334.859677:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788664334.859683:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664334.859719:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.859759:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be905f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437d6 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.859782:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437d6 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.859790:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:2.0:1788664334.859793:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664334.859796:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef800, rc 0) 00000100:00100000:2.0:1788664334.859841:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+46:10417:x1875550204365056:12345-192.168.202.14@tcp:101:bash.0 Request processed in 6016us (6128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664334.859849:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:0.0:1788664334.864126:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.864183:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204365440 00000100:00100000:3.0:1788664334.864193:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204365440 00000100:00100000:3.0:1788664334.864317:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:3.0:1788664334.864328:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+46:10417:x1875550204365440:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:0.0:1788664334.864885:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10417:x1875550204365440:12345-192.168.202.14@tcp:35:bash.0 Request processed in 556us (766us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788664334.864893:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:0.0:1788664334.942164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664334.942408:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204365696 00000100:00100000:2.0:1788664334.942417:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204365696 00000100:00100000:2.0:1788664334.942469:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:2.0:1788664334.942478:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10427:x1875550204365696:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664334.942504:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664334.942524:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437dd expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664334.942734:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788664334.942850:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90604 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437dd expref: 49 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.942862:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:2.0:1788664334.942864:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664334.942868:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437dd expref: 49 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.942886:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb200, rc 0) 00000100:00100000:2.0:1788664334.942973:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+48:10427:x1875550204365696:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 491us (816us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788664334.942978:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:2.0:1788664334.944975:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664334.945492:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204365824 00000100:00100000:0.0:1788664334.945502:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204365824 00000100:00100000:0.0:1788664334.945571:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788664334.945581:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+48:10427:x1875550204365824:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:0.0:1788664334.945657:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945673:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945692:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945707:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945730:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945737:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945811:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945817:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945821:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664334.945859:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945869:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945873:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945878:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945883:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664334.945886:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945891:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945904:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664334.945906:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664334.945909:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945913:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945923:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945926:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945930:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945933:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664334.945935:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945938:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945942:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346a00) 00010000:00010000:0.0:1788664334.945943:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664334.945944:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945947:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945965:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945971:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945977:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945981:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664334.945984:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945990:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.945997:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:0.0:1788664334.945999:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664334.946002:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.946008:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664334.946082:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+48:10427:x1875550204365824:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 503us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664334.946088:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788664334.947839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664334.947896:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204366080 00000100:00100000:1.0:1788664334.947904:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204366080 00000100:00100000:1.0:1788664334.947964:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788664334.947974:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+48:10427:x1875550204366080:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788664334.948170:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+49:10427:x1875550204366080:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 198us (337us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788664334.948178:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788664334.967901:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664334.968021:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204366336 00000100:00100000:2.0:1788664334.968030:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204366336 00000100:00100000:2.0:1788664334.968116:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:2.0:1788664334.968127:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+49:10430:x1875550204366336:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664334.968153:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664334.968179:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437e4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968269:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968285:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968296:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968312:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968318:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968389:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968547:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9063c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968558:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9063c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968568:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9063c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664334.968579:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788664334.968717:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968726:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968735:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968742:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664334.968747:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968755:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968769:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664334.968772:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664334.968784:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968792:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9062e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968806:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968812:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968819:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968825:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664334.968828:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968834:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968842:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e9affa00) 00010000:00010000:2.0:1788664334.968845:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664334.968848:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968854:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968906:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437e4 expref: 52 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968931:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9063c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437e4 expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664334.968939:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:2.0:1788664334.968942:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664334.968945:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eaa00, rc 0) 00000100:00100000:2.0:1788664334.969018:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+51:10430:x1875550204366336:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 893us (1126us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788664334.969026:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:2.0:1788664334.971950:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664334.972064:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664334.972137:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204366592 00000100:00100000:3.0:1788664334.972146:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204366592 00000100:00100000:3.0:1788664334.972209:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:3.0:1788664334.972221:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+51:10430:x1875550204366592:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:3.0:1788664334.972296:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972313:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972325:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972478:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972488:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972495:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972501:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664334.972506:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972514:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972552:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664334.972555:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664334.972561:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664334.972568:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be9064a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664334.972703:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+51:10430:x1875550204366592:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 484us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664334.972712:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:0.0:1788664334.972936:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204366464 00000100:00100000:0.0:1788664334.972945:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204366464 00000100:00100000:0.0:1788664334.973033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788664334.973042:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+51:2359:x1875550204366464:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664334.973055:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664334.973073:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9063c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437e4 expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664334.973087:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:0.0:1788664334.973091:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664334.973113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+50:2359:x1875550204366464:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 74us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664334.973120:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788664334.976168:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664334.976235:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204366848 00000100:00100000:2.0:1788664334.976244:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204366848 00000100:00100000:2.0:1788664334.976304:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788664334.976314:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+50:10430:x1875550204366848:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664334.976618:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+51:10430:x1875550204366848:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 305us (459us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788664334.976626:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788664335.086673:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664335.086848:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204367104 00000100:00100000:1.0:1788664335.086858:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204367104 00000100:00100000:1.0:1788664335.086975:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:1.0:1788664335.086985:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+51:10448:x1875550204367104:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:1.0:1788664335.087011:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664335.087030:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437eb expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.087130:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90658 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.087141:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.087150:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90658 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664335.087168:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788664335.087277:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437eb expref: 54 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.087292:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90658 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437eb expref: 53 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.087298:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:1.0:1788664335.087300:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788664335.087302:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478200, rc 0) 00000100:00100000:1.0:1788664335.087394:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+53:10448:x1875550204367104:12345-192.168.202.14@tcp:101:cat.0 Request processed in 410us (832us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788664335.087401:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00080000:2.0:1788664335.088128:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664335.104370:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664335.104543:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204367232 00000100:00100000:2.0:1788664335.104552:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204367232 00000100:00100000:2.0:1788664335.104651:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:2.0:1788664335.104662:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+53:10449:x1875550204367232:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664335.104696:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664335.104717:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437f2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.104797:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9066d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.104808:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9066d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.104818:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9066d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664335.104858:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788664335.104861:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664335.104876:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9066d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.104897:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f2 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.104910:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9066d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f2 expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.104916:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664335.104918:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664335.104921:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea800, rc 0) 00000100:00100000:2.0:1788664335.105003:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10449:x1875550204367232:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 344us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664335.105008:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:0.0:1788664335.108432:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664335.108559:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204367616 00000100:00100000:2.0:1788664335.108581:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204367616 00000100:00100000:2.0:1788664335.108695:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788664335.108704:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10449:x1875550204367616:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664335.109005:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10449:x1875550204367616:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 302us (584us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788664335.109011:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:0.0:1788664335.111110:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664335.111253:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204367744 00000100:00100000:1.0:1788664335.111272:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204367744 00000100:00100000:1.0:1788664335.111324:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788664335.111334:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10449:x1875550204367744:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:1.0:1788664335.111374:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788664335.111404:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be905fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437d6 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.111427:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437eb expref: 54 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.111441:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243797 expref: 53 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.111452:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:1.0:1788664335.111463:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664335.111637:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9337100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10449:x1875550204367744:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 303us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.111645:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:0.0:1788664335.113108:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664335.113155:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204367872 00000100:00100000:3.0:1788664335.113163:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204367872 00000100:00100000:3.0:1788664335.113212:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:3.0:1788664335.113221:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10449:x1875550204367872:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:3.0:1788664335.113334:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.113364:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.113376:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664335.113880:0:5855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664335.114033:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788664335.114077:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788664335.114153:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10449:x1875550204367872:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 930us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664335.114171:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00010000:00010000:2.0:1788664335.135849:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664335.139056:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664335.139157:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368000 00000100:00100000:3.0:1788664335.139166:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368000 00000100:00100000:3.0:1788664335.139301:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:3.0:1788664335.139312:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10451:x1875550204368000:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664335.139334:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664335.139371:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9067b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2437f9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139463:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139492:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139510:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139525:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139533:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139540:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139635:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139654:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139661:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664335.139709:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788664335.139715:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664335.139735:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139748:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139758:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139764:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139771:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139778:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664335.139783:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139791:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139803:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664335.139806:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664335.139820:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139826:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139840:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139846:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139851:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139856:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147ac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664335.139858:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139864:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139871:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811600) 00010000:00010000:3.0:1788664335.139873:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664335.139876:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139881:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139915:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be9067b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 54 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139939:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.139947:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664335.139950:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664335.139953:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b200, rc 0) 00000100:00100000:3.0:1788664335.140068:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+53:10451:x1875550204368000:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 758us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664335.140076:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00000001:00080000:3.0:1788664335.781139:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000001:00080000:3.0:1788664335.781169:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1788664335.781190:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:3.0:1788664335.781223:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788664335.789737:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222222592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788664335.789817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664335.789980:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222222592 00000100:00100000:1.0:1788664335.789989:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222222592 00000100:00100000:1.0:1788664335.790058:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664335.790069:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222222592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788664335.790099:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788664335.790134:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9cda0e, atime: 0x6a9cda0e, ctime: 0x6a9cda0e, blocks: 0xb 00010000:00010000:1.0:1788664335.790143:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.790179:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=369s v=(0 0) 00010000:00010000:1.0:1788664335.790184:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664335.790190:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.790207:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.790232:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.790241:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.790260:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788664335.795543:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c7ebd480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788664335.795555:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68c3ff1f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c7ebdd80 00000020:00080000:3.0:1788664335.795559:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68c3ff1500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c824d800 00000020:00080000:3.0:1788664335.795618:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788664335.795758:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:0.0:1788664335.798515:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664335.801752:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222222592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11674us (11923us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788664335.801767:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788664335.801799:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664335.801807:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.801819:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664335.801824:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664335.801830:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788664335.801846:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664335.801858:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788664335.801880:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664335.801880:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788664335.801889:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008012ac04/0x762f55027be90697 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664335.801902:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788664335.801912:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664335.801914:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664335.801916:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664335.801923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368128 00000100:00100000:1.0:1788664335.801930:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368384 00000100:00100000:0.0:1788664335.801931:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368128 00000100:00100000:1.0:1788664335.801933:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368384 00000100:00100000:0.0:1788664335.801970:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 288 00000100:00100000:1.0:1788664335.801972:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:1.0:1788664335.801977:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204368384:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664335.801977:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204368128:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664335.802045:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204368128:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.802051:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204368384:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664335.802052:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 288 00000100:00100000:1.0:1788664335.802057:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:0.0:1788664335.802081:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368256 00000100:00100000:0.0:1788664335.802084:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368256 00000100:00100000:0.0:1788664335.802114:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368512 00000100:00100000:0.0:1788664335.802118:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368512 00000100:00100000:0.0:1788664335.802142:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00100000:0.0:1788664335.802149:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+11:2361:x1875550204368256:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664335.802178:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+11:2361:x1875550204368256:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664335.802184:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00100000:0.0:1788664335.802195:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 138 00000100:00100000:0.0:1788664335.802202:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2361:x1875550204368512:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664335.802226:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2361:x1875550204368512:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664335.802244:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 138 00000100:00080000:0.0:1788664335.802394:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664335.802399:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788664335.820917:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68f8cef100/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788664335.820932:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222222592:0@lo:6:osp-syn-1-0.0 00000040:00080000:3.0:1788664335.840112:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664335.840121:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664335.840184:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788664335.840194:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664335.840326:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f34380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222222720:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788664335.840830:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664335.848149:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664335.848459:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f34380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222222720:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788664335.849789:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368640 00000100:00100000:1.0:1788664335.849800:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368640 00000100:00100000:1.0:1788664335.849958:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788664335.849969:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10462:x1875550204368640:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788664335.850105:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10462:x1875550204368640:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 Request processed in 138us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.850121:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:0.0:1788664335.855172:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664335.855247:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368768 00000100:00100000:1.0:1788664335.855258:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368768 00000100:00100000:1.0:1788664335.855322:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:1.0:1788664335.855332:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10462:x1875550204368768:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664335.855453:0:5854:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664335.855707:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10462:x1875550204368768:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 375us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.855714:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:2.0:1788664335.864235:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664335.864515:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204368896 00000100:00100000:0.0:1788664335.864527:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204368896 00000100:00100000:0.0:1788664335.864593:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:0.0:1788664335.864604:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10462:x1875550204368896:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788664335.864700:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864725:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864738:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864753:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864759:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864764:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864791:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864799:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864806:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664335.864859:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788664335.864865:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664335.864882:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864895:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864911:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864917:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864923:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664335.864928:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864935:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864960:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:0.0:1788664335.864963:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664335.864967:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864973:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9069e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864984:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864989:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864994:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.864998:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664335.865007:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865013:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865019:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b68e1346600) 00010000:00010000:0.0:1788664335.865022:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664335.865025:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865030:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865044:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865050:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865055:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865061:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664335.865064:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865236:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865247:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:0.0:1788664335.865249:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664335.865258:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.865263:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664335.865384:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10462:x1875550204368896:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 780us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664335.865412:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:0.0:1788664335.869783:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664335.869891:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204369152 00000100:00100000:1.0:1788664335.869902:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204369152 00000100:00100000:1.0:1788664335.869959:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:1.0:1788664335.869969:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10462:x1875550204369152:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664335.869989:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664335.870009:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243800 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870115:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870131:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870142:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664335.870154:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788664335.870384:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870393:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870408:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870415:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664335.870420:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870427:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870440:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:1.0:1788664335.870443:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664335.870459:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870466:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870512:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243800 expref: 13 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870523:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:1.0:1788664335.870525:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664335.870529:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243800 expref: 13 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.870549:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478600, rc 0) 00000100:00100000:1.0:1788664335.870608:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204369152:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 640us (837us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788664335.870617:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:0.0:1788664335.874142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664335.874288:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204369280 00000100:00100000:1.0:1788664335.874309:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204369280 00000100:00100000:1.0:1788664335.874387:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:1.0:1788664335.874410:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204369280:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664335.874454:0:5856:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664335.874596:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204369280:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 195us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.874605:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:1.0:1788664335.884535:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664335.887664:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204369536 00000100:00100000:0.0:1788664335.887679:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204369536 00000100:00100000:0.0:1788664335.887742:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:0.0:1788664335.887752:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204369536:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664335.887777:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664335.887780:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788664335.887819:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9066d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f2 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.887837:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664335.887842:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664335.887856:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243807 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664335.888651:0:7653:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788664335.888916:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.888931:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.888942:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.889010:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be906c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243807 expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.889024:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243807 expref: 13 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.889033:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:0.0:1788664335.889035:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664335.889038:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef800, rc 0) 00000100:00100000:0.0:1788664335.889117:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10462:x1875550204369536:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1366us (4593us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788664335.889126:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 72 00000040:00080000:1.0:1788664335.908143:0:12008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664335.908153:0:12008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788664335.908180:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000040:00080000:1.0:1788664335.908207:0:12008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788664335.908212:0:12008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664335.908213:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204369792 00000100:00100000:0.0:1788664335.908221:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204369792 00000100:00100000:0.0:1788664335.908263:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:0.0:1788664335.908273:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10462:x1875550204369792:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788664335.908366:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664335.908393:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be906cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243807 expref: 13 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908422:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:0.0:1788664335.908434:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664335.908459:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908497:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908507:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908522:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908529:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908534:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908715:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908722:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908728:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908734:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664335.908738:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908744:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908752:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664335.908760:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664335.908765:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908771:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be906dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908780:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908785:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908789:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908794:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664335.908797:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908812:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908820:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6639d574 (ffff9b68e1346700) 00010000:00010000:0.0:1788664335.908823:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664335.908826:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664335.908831:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be906e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6639d574 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664335.908918:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204369792:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 645us (741us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664335.908939:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:1.0:1788664335.911719:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664335.911755:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204369920 00000100:00100000:1.0:1788664335.911764:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204369920 00000100:00100000:1.0:1788664335.911824:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:1.0:1788664335.911834:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204369920:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664335.911855:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664335.911877:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24380e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.911933:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.911951:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.911960:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.912051:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be906eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.912072:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664335.912079:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:1.0:1788664335.912081:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788664335.912084:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478600, rc 0) 00000100:00100000:1.0:1788664335.912135:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10462:x1875550204369920:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 302us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.912142:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:0.0:1788664335.916338:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664335.916556:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204370176 00000100:00100000:2.0:1788664335.916566:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204370176 00000100:00100000:2.0:1788664335.916629:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 75 00000100:00100000:2.0:1788664335.916643:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10462:x1875550204370176:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664335.916742:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.916755:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.916765:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664335.917224:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1788664335.917233:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369900890586ns, next at 370900888721ns, rc = 0 00000004:00010000:2.0:1788664335.917304:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098654505 reply state 00000000bce983cb transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664335.917315:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664335.917452:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10462:x1875550204370176:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 809us (1287us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788664335.917460:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 75 00010000:00010000:3.0:1788664335.919562:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.919578:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.919586:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.919593:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eba00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664335.919598:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.919605:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.919623:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:3.0:1788664335.919627:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788664335.919632:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664335.919638:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be906f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664335.920582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664335.921044:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204370304 00000100:00100000:2.0:1788664335.921055:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204370304 00000100:00100000:2.0:1788664335.921119:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:2.0:1788664335.921130:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10462:x1875550204370304:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664335.921155:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664335.921174:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243815 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.921240:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.921255:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664335.921276:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:2.0:1788664335.921280:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664335.921283:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea200, rc 0) 00000100:00100000:2.0:1788664335.921364:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10462:x1875550204370304:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 235us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664335.921372:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:2.0:1788664335.930248:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664335.930502:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204370432 00000100:00100000:0.0:1788664335.930512:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204370432 00000100:00100000:0.0:1788664335.930621:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788664335.930629:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875550204370432:12345-192.168.202.14@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788664335.930664:0:8476:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp t0 exp 0000000000000000 cur 369 last 0 00000020:00000080:0.0:1788664335.930698:0:8476:0:(genops.c:1385:class_connect()) connect: client 5e600724-38bd-4119-be7d-5264f08f0aa5, cookie 0x762f55027be90707 00002000:00100000:0.0:1788664335.930711:0:8476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5e600724-38bd-4119-be7d-5264f08f0aa5/ffff9b68d8575000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788664335.930735:0:8476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b6, return b6 00002000:00080000:1.0:1788664335.936675:0:8476:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788664335.936722:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9b68fb24a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664335.936822:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2357:x1875550204370432:12345-192.168.202.14@tcp:8:lhsmtool_posix.0 Request processed in 6190us (6579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664335.936834:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:0.0:1788664335.939969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664335.940038:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204370560 00000100:00100000:2.0:1788664335.940049:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204370560 00000100:00100000:2.0:1788664335.940119:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:2.0:1788664335.940130:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:0:x1875550204370560:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788664335.940268:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788664336.038056:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000001:00080000:2.0:1788664336.038073:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1788664336.038155:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:0:x1875550204370560:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 98019us (98186us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788664336.038166:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:2.0:1788664336.041228:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664336.041713:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204370816 00000100:00100000:1.0:1788664336.041732:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204370816 00000100:00100000:1.0:1788664336.041793:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788664336.041804:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10462:x1875550204370816:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788664336.042217:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10462:x1875550204370816:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 414us (998us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788664336.042226:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:3.0:1788664336.048017:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664336.048394:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204371072 00000100:00100000:1.0:1788664336.048406:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204371072 00000100:00100000:1.0:1788664336.048462:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:1.0:1788664336.048471:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10462:x1875550204371072:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788664336.048583:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10462:x1875550204371072:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 113us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664336.048590:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:3.0:1788664336.050419:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664336.050548:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204371200 00000100:00100000:1.0:1788664336.050557:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204371200 00000100:00100000:1.0:1788664336.050618:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:1.0:1788664336.050630:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10462:x1875550204371200:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664336.050652:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664336.050675:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9070e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24381c expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.050765:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.050779:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.050805:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664336.050847:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664336.050867:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.050900:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be9070e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24381c expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.050916:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24381c expref: 17 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.050937:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:1.0:1788664336.050940:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788664336.050943:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479a00, rc 0) 00000100:00100000:1.0:1788664336.050990:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10462:x1875550204371200:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 364us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664336.050996:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:1.0:1788664336.053643:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.053766:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204371328 00000100:00100000:3.0:1788664336.053776:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204371328 00000100:00100000:3.0:1788664336.053860:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:3.0:1788664336.053870:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204371328:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664336.053890:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664336.054002:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243823 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664336.054126:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cda10, blocks: 0x1 00010000:00010000:3.0:1788664336.054148:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1788664336.054153:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664336.054163:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.054472:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.054487:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b000, rc 0) 00000100:00100000:3.0:1788664336.054557:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204371328:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 688us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664336.054565:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:1.0:1788664336.056772:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.056839:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204371584 00000100:00100000:3.0:1788664336.056847:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204371584 00000100:00100000:3.0:1788664336.056893:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788664336.056901:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10462:x1875550204371584:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788664336.056987:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10462:x1875550204371584:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664336.056993:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:3.0:1788664336.058652:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664336.058852:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204371712 00000100:00100000:1.0:1788664336.058861:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204371712 00000100:00100000:1.0:1788664336.058905:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:1.0:1788664336.058915:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:10462:x1875550204371712:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664336.058940:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664336.058964:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24382a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.059004:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.059013:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664336.059017:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664336.059022:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.059057:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.059072:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 7 pid: 6697 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664336.059087:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875550222222848:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664336.059200:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d415b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788664336.062391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.062658:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875550222222848:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664336.062702:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.062736:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479400, rc 0) 00000100:00100000:3.0:1788664336.062818:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:10462:x1875550204371712:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3903us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664336.062830:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:2.0:1788664336.062919:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204371840 00000100:00100000:2.0:1788664336.062928:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204371840 00010000:00010000:2.0:1788664336.062965:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 7 pid: 6697 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664336.063014:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:2.0:1788664336.063026:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5893450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204371840:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664336.063053:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664336.063081:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 7 pid: 6697 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.063094:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 7 pid: 6697 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.063119:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd7e1c09/0x762f55027be9071c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243823 expref: 7 pid: 6697 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.063143:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664336.063148:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664336.063158:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.063169:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.063203:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664336.063218:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5840:1875550222222976:192.168.202.14@tcp:105: 00000100:00100000:2.0:1788664336.063288:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c93313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664336.073640:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.073834:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5840:1875550222222976:192.168.202.14@tcp:105: 00010000:00010000:3.0:1788664336.073860:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664336.073951:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5893450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204371840:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 10926us (11613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664336.073964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:1.0:1788664336.074187:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204371968 00000100:00100000:1.0:1788664336.074194:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204371968 00002000:00100000:1.0:1788664336.074240:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b68e7f06300 x1875550204371968/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:642/0 lens 504/0 e 0 to 0 dl 1788664347 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664336.074251:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68e7f06300 with x1875550204371968 ext(0->8) 00002000:00010000:1.0:1788664336.074256:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68e7f06300 00000100:00100000:1.0:1788664336.074294:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788664336.074311:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204371968:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788664336.075042:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204371968:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 731us (1411us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788664336.075051:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00002000:00100000:1.0:1788664336.075058:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b68e7f06300 x1875550204371968/t4294967302(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:642/0 lens 504/448 e 0 to 0 dl 1788664347 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664336.075067:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68e7f06300 with x1875550204371968 ext(0->8) 00002000:00010000:1.0:1788664336.075071:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68e7f06300 00000100:00100000:1.0:1788664336.078621:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664336.078711:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204372096 00000100:00100000:2.0:1788664336.078720:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204372096 00000100:00100000:2.0:1788664336.078803:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:2.0:1788664336.078816:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10462:x1875550204372096:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788664336.117304:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:3.0:1788664336.117321:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788664336.117333:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788664336.117738:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222223104:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788664336.117765:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788664336.117784:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788664336.117792:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788664336.117842:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664336.117971:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10462:x1875550204372096:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 39155us (39356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664336.117982:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:1.0:1788664336.118052:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222223104 00000100:00100000:1.0:1788664336.118059:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222223104 00000100:00100000:1.0:1788664336.118115:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664336.118126:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222223104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788664336.118264:0:8476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788664336.118267:0:8476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788664336 00002000:00010000:1.0:1788664336.118270:0:8476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788664336.118272:0:8476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788664336 -> 1788664336 00002000:00010000:1.0:1788664336.118273:0:8476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788664336.118310:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222223104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (504us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788664336.118317:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1788664336.118363:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68f8cece00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788664336.118406:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222223104:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788664336.118544:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664336.120824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664336.120865:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204372224 00000100:00100000:0.0:1788664336.120874:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204372224 00000100:00100000:0.0:1788664336.120920:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:0.0:1788664336.120928:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204372224:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788664336.148917:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1788664336.148933:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788664336.149131:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204372224:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 28195us (28308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664336.149162:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:0.0:1788664336.152050:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.152118:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204372480 00000100:00100000:3.0:1788664336.152129:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204372480 00000100:00100000:3.0:1788664336.152188:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:3.0:1788664336.152198:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10462:x1875550204372480:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664336.152267:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664336.152297:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24381c expref: 13 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.152337:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:3.0:1788664336.152372:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664336.152407:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.152421:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.152431:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664336.152706:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001da970bf reply state 00000000673cc44a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664336.152717:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664336.153243:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10462:x1875550204372480:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 1044us (1201us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788664336.153261:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:0.0:1788664336.156163:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.156700:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204372608 00000100:00100000:3.0:1788664336.156710:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204372608 00000100:00100000:3.0:1788664336.156764:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:3.0:1788664336.156773:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204372608:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788664336.157012:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788664336.157016:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788664336 -> 1788664335 00002000:00010000:3.0:1788664336.157019:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788664334 00002000:00010000:3.0:1788664336.157021:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788664336 -> 1788664335 00002000:00010000:3.0:1788664336.157024:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788664336.157081:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204372608:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 308us (929us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788664336.157089:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00010000:00010000:2.0:1788664336.157206:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.157216:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.157224:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.157231:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147ac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664336.157235:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.157244:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.157268:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:2.0:1788664336.157272:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664336.157276:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.157283:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be9072a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664336.160997:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.161079:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204372864 00000100:00100000:3.0:1788664336.161089:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204372864 00000100:00100000:3.0:1788664336.161177:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:3.0:1788664336.161188:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10462:x1875550204372864:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788664336.161324:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.161454:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.161465:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.161507:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.161585:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 13 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664336.161600:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222223232:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664336.161708:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd300 going to sleep for 11 seconds 00010000:00010000:2.0:1788664336.161801:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664336.165210:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.165446:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222223232:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664336.165483:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664336.165820:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204372992 00000100:00100000:1.0:1788664336.165828:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204372992 00010000:00010000:1.0:1788664336.165864:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664336.165949:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:1.0:1788664336.165959:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+14:2361:x1875550204372992:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664336.165976:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664336.165984:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.165997:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.166018:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be906f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24380e expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.166046:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:1.0:1788664336.166052:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.166061:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.166068:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.166095:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664336.166151:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2361:x1875550204372992:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 193us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664336.166158:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00010000:00010000:0.0:1788664336.166883:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166894:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166927:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166935:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166942:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166948:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664336.166953:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166961:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166971:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:0.0:1788664336.166973:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788664336.166977:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664336.166983:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90731 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664336.167056:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204372864:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 5868us (6067us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788664336.167065:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:0.0:1788664336.169474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.169844:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204373120 00000100:00100000:3.0:1788664336.169853:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204373120 00000100:00100000:3.0:1788664336.169914:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:3.0:1788664336.169924:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204373120:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788664336.169967:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.169986:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.169994:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664336.169998:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664336.170003:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.170036:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.170049:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 7 pid: 6694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664336.170065:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875550222223360:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664336.170141:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664336.172893:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875550222223360:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664336.172921:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664336.173488:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.173584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204373248 00000100:00100000:3.0:1788664336.173591:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204373248 00010000:00010000:3.0:1788664336.173624:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 8 pid: 6694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664336.173654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:3.0:1788664336.173663:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204373248:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664336.173678:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664336.173702:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 8 pid: 6694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.173714:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 8 pid: 6694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.173737:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90723 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24382a expref: 8 pid: 6694 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.173755:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664336.173760:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664336.173766:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.173776:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.173819:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664336.173869:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204373248:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 207us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664336.173877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00010000:00010000:1.0:1788664336.174501:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174523:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174549:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174558:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174566:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174572:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147ac00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664336.174577:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174585:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174599:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.174606:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000403dff96/0x762f55027be90738 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664336.174687:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204373120:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 4763us (5220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664336.174695:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:0.0:1788664336.178153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664336.178242:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204373504 00000100:00100000:1.0:1788664336.178306:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204373504 00000100:00100000:1.0:1788664336.178472:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:1.0:1788664336.178484:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+12:10462:x1875550204373504:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788664336.178583:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.178601:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.178611:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.178812:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.178825:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.178833:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.178868:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.178903:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 13 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664336.178919:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8ced180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222223488:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664336.179043:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664336.182683:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8ced180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222223488:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664336.182713:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664336.182786:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664336.182855:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204373632 00000100:00100000:2.0:1788664336.182863:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204373632 00010000:00010000:2.0:1788664336.182901:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664336.182959:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788664336.182968:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+14:2360:x1875550204373632:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664336.182984:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664336.182991:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.183003:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.183026:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243815 expref: 14 pid: 5854 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.183040:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:2.0:1788664336.183046:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.183056:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.183064:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.183093:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664336.183143:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2360:x1875550204373632:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 176us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664336.183151:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00010000:00010000:3.0:1788664336.183207:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.183215:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664336.183428:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788664336.183579:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788664336.183621:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788664336.183697:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5855:1875550222223616:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788664336.183743:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664336.183769:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664336.184149:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222223616 00000100:00100000:2.0:1788664336.184162:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222223616 00000100:00100000:2.0:1788664336.184200:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664336.184208:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1875550222223616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788664336.184282:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1875550222223616:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664336.184289:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664336.185078:0:5855:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788664336.185086:0:5855:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68f8cece00, transno 4294967303 00000100:00100000:3.0:1788664336.185205:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5855:1875550222223616:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788664336.186071:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788664336.186168:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5855:1875550222223744:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788664336.186229:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664336.186262:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664336.186636:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222223744 00000100:00100000:2.0:1788664336.186643:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222223744 00000100:00100000:2.0:1788664336.186697:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664336.186708:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5855:x1875550222223744:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788664336.186898:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5855:x1875550222223744:12345-0@lo:1000:mdt00_001.0 Request processed in 192us (668us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788664336.186906:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664336.187395:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5855:1875550222223744:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788664336.187437:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187462:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187479:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187487:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664336.187492:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187500:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187525:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969f00) 00010000:00010000:3.0:1788664336.187528:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664336.187533:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187540:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90746 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187584:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187591:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187597:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187603:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664336.187613:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187619:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187627:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664336.187630:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664336.187633:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187638:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90674 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187661:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187675:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187683:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187710:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.187722:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 16 pid: 5856 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664336.187734:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f36680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222223872:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664336.187804:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788664336.191168:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664336.191208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204373760 00000100:00100000:3.0:1788664336.191217:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204373760 00010000:00010000:3.0:1788664336.191312:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 17 pid: 5856 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664336.191377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788664336.191389:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+17:2361:x1875550204373760:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664336.191403:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664336.191411:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 17 pid: 5856 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.191423:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 17 pid: 5856 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.191444:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:3.0:1788664336.191450:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.191460:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.191467:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.191497:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664336.191624:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2437f9 expref: 17 pid: 5856 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664336.191641:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f36680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222223872:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664336.191661:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191671:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191678:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191691:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191713:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191719:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191725:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664336.191729:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191736:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191745:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:2.0:1788664336.191747:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664336.191751:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191756:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9074d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191766:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191772:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191777:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191781:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664336.191788:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191794:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191801:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811d00) 00010000:00010000:2.0:1788664336.191804:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664336.191806:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.191811:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be9073f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664336.192097:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664336.192103:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664336.192129:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788664336.192135:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664336.192229:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10462:x1875550204373504:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 13745us (14084us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788664336.192238:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00000020:00080000:2.0:1788664336.192242:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788664336.192463:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+15:2361:x1875550204373760:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1077us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664336.192928:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:2.0:1788664336.195989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664336.196081:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204374016 00000100:00100000:1.0:1788664336.196091:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204374016 00000100:00100000:1.0:1788664336.196171:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788664336.196181:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10462:x1875550204374016:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788664336.197088:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788664336.197185:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788664336.197229:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.197305:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.197320:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.197329:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.197681:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.197690:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664336.197756:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664336.197867:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10462:x1875550204374016:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 1684us (1885us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788664336.197876:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000020:00080000:1.0:1788664336.197881:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788664336.205440:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664336.205463:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.205657:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664336.205663:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.205674:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.205694:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b68dc969700) 00010000:00010000:3.0:1788664336.205697:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788664336.205702:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664336.205709:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90754 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664336.205819:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664336.205822:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664336.205825:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664337.183504:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664337.697104:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664337.697126:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222224000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664337.697198:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664337.697497:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222224000 00000100:00100000:3.0:1788664337.697505:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222224000 00000100:00100000:3.0:1788664337.697557:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788664337.697567:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222224000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664337.697601:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664337.697658:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222224000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664337.697665:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788664337.697743:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222224000:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788664337.857068:0:12060:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664337.857077:0:12060:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664337.857116:0:12060:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788664337.857122:0:12060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664338.046420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.046521:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204374272 00000100:00100000:2.0:1788664338.046532:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204374272 00000100:00100000:2.0:1788664338.046615:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:2.0:1788664338.046626:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+17:10480:x1875550204374272:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664338.046670:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664338.046693:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be9075b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243831 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.046821:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eae00/0x762f55027be90762 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.046836:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eae00/0x762f55027be90762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.046851:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eae00/0x762f55027be90762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664338.046865:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788664338.047228:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be9075b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243831 expref: 20 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.047248:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eae00/0x762f55027be90762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243831 expref: 19 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.047258:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664338.047262:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664338.047265:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eae00, rc 0) 00000100:00100000:2.0:1788664338.047335:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+19:10480:x1875550204374272:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 710us (926us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788664338.047374:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00080000:0.0:1788664338.047594:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664338.052112:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.052167:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204374400 00000100:00100000:3.0:1788664338.052177:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204374400 00000100:00100000:3.0:1788664338.052283:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:3.0:1788664338.052307:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:10480:x1875550204374400:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788664338.052452:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052484:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052497:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052521:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052529:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052537:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052745:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052754:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052761:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664338.052811:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052828:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052841:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052848:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052855:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664338.052860:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052868:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052880:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664338.052883:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664338.052888:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052893:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052907:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052914:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052920:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052925:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664338.052932:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052939:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052946:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811200) 00010000:00010000:3.0:1788664338.052948:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664338.052951:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052956:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052970:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052977:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052984:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.052989:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664338.053004:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.053010:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.053017:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68c3811a00) 00010000:00010000:3.0:1788664338.053019:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664338.053028:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.053034:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be9077e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664338.053130:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:10480:x1875550204374400:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 823us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664338.053139:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:3.0:1788664338.099065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.099197:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204374656 00000100:00100000:0.0:1788664338.099217:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204374656 00000100:00100000:0.0:1788664338.099368:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:0.0:1788664338.099381:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:10483:x1875550204374656:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664338.099405:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664338.099427:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90785 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243838 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099525:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099540:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099566:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099583:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099591:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099597:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099858:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099867:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.099879:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664338.099889:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788664338.099996:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100004:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100012:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100017:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.100028:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100037:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100049:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664338.100051:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.100057:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100063:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9078c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100075:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100081:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100086:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100103:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.100107:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100113:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100120:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346a00) 00010000:00010000:0.0:1788664338.100122:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.100132:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100138:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100185:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90785 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100198:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.100206:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:0.0:1788664338.100208:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664338.100211:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efa00, rc 0) 00000100:00100000:0.0:1788664338.100280:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10483:x1875550204374656:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 902us (1226us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788664338.100287:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:0.0:1788664338.102749:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.102831:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204374784 00000100:00100000:2.0:1788664338.102842:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204374784 00000100:00100000:2.0:1788664338.102892:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:2.0:1788664338.102910:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10483:x1875550204374784:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788664338.102967:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.102979:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.102988:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.103008:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.103013:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.103017:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.103021:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664338.103024:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.103029:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.103036:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:2.0:1788664338.103038:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664338.103041:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.103045:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.103156:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10483:x1875550204374784:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 245us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664338.103164:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:3.0:1788664338.106991:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.107159:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204375040 00000100:00100000:2.0:1788664338.107168:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204375040 00000100:00100000:2.0:1788664338.107405:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788664338.107416:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10483:x1875550204375040:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664338.107659:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+22:10483:x1875550204375040:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 235us (667us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788664338.107667:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:1.0:1788664338.155112:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.155264:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204375296 00000100:00100000:2.0:1788664338.155275:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204375296 00000100:00100000:2.0:1788664338.155410:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:2.0:1788664338.155422:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+22:10005:x1875550204375296:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788664338.155449:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664338.155471:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24383f expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.155604:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.155619:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.155628:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.155689:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.155704:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 23 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.155718:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222224128:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664338.155814:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664338.162426:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222224128:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664338.162462:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664338.165297:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.167102:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204375424 00000100:00100000:2.0:1788664338.167117:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204375424 00010000:00010000:2.0:1788664338.167167:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 24 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.167214:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:2.0:1788664338.167224:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+24:2360:x1875550204375424:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664338.167240:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664338.167247:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 24 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167260:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 24 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167300:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9079a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243838 expref: 24 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167317:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:2.0:1788664338.167322:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167331:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167434:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167462:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664338.167564:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+23:2360:x1875550204375424:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 320us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664338.167572:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00010000:00010000:2.0:1788664338.167701:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167709:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664338.167728:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788664338.167909:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be907af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 24 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167924:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 23 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.167942:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:2.0:1788664338.167945:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664338.167948:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb000, rc 0) 00000100:00100000:2.0:1788664338.167982:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+23:10005:x1875550204375296:12345-192.168.202.14@tcp:101:bash.0 Request processed in 12563us (12880us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788664338.167989:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788664338.172374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664338.172455:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204375680 00000100:00100000:1.0:1788664338.172466:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204375680 00000100:00100000:1.0:1788664338.172530:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:1.0:1788664338.172543:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+23:10005:x1875550204375680:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:1.0:1788664338.172845:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.172863:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.172890:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664338.172969:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788664338.173009:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e342f3c reply state 000000000c9ad594 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664338.173018:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788664338.173071:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788664338.175798:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+27:10005:x1875550204375680:12345-192.168.202.14@tcp:36:bash.0 Request processed in 3240us (3415us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788664338.175813:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 89 00000020:00080000:1.0:1788664338.175822:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788664338.180732:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.180752:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.180761:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.180769:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664338.180774:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.180782:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.180799:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:1.0:1788664338.180803:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664338.180943:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.180970:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be907c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.182333:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.182418:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204375808 00000100:00100000:3.0:1788664338.182429:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204375808 00000100:00100000:3.0:1788664338.182494:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:3.0:1788664338.182504:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+26:10005:x1875550204375808:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788664338.182527:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664338.182545:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be907cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243846 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.182661:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be907cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243846 expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.182673:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be907cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243846 expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.182693:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:3.0:1788664338.182696:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664338.182698:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a600, rc 0) 00000100:00100000:3.0:1788664338.182767:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+27:10005:x1875550204375808:12345-192.168.202.14@tcp:101:bash.0 Request processed in 264us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664338.182774:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:3.0:1788664338.184910:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.185022:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204375936 00000100:00100000:0.0:1788664338.185031:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204375936 00000100:00100000:0.0:1788664338.185116:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:0.0:1788664338.185127:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dffa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:10005:x1875550204375936:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664338.185143:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664338.185164:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24384d expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664338.185190:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cda0f, atime: 0x6a9cda0e, ctime: 0x6a9cda0f, blocks: 0xb 00010000:00010000:0.0:1788664338.185224:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788664338.185239:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664338.185249:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.185268:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.185281:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee200, rc 0) 00000100:00100000:0.0:1788664338.185363:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dffa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:10005:x1875550204375936:12345-192.168.202.14@tcp:101:bash.0 Request processed in 215us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664338.185371:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00080000:2.0:1788664338.187076:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664338.187588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.188094:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204376064 00000100:00100000:2.0:1788664338.188104:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204376064 00002000:00010000:2.0:1788664338.188146:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788664338.188151:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8cef800 with x1875550204376064 ext(0->18446744073709551615) 00002000:00010000:2.0:1788664338.188162:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68f8cef800. 00000100:00100000:2.0:1788664338.188197:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:2.0:1788664338.188207:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204376064:12345-192.168.202.14@tcp:10:bash.0 00002000:00010000:2.0:1788664338.188526:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788664338.188530:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788664335 -> 1788664339 00002000:00010000:2.0:1788664338.188532:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788664334 -> 1788664334 00002000:00010000:2.0:1788664338.188535:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788664335 -> 1788664339 00002000:00010000:2.0:1788664338.188537:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788664338.188738:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204376064:12345-192.168.202.14@tcp:10:bash.0 Request processed in 531us (1152us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788664338.188746:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00002000:00010000:2.0:1788664338.188750:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788664338.188752:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8cef800 with x1875550204376064 ext(0->18446744073709551615) 00002000:00010000:2.0:1788664338.188771:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68f8cef800. 00010000:00010000:2.0:1788664338.207753:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664338.271885:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664338.271895:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664338.271928:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788664338.271934:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664338.320809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.320966:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204376192 00000100:00100000:0.0:1788664338.320976:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204376192 00000100:00100000:0.0:1788664338.321042:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:0.0:1788664338.321053:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+27:10497:x1875550204376192:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:0.0:1788664338.321170:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321189:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321202:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321229:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321236:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321260:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321727:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321738:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321746:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664338.321794:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321806:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321813:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321819:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321826:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.321830:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321838:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321850:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664338.321859:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.321866:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321873:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be907d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321886:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321890:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321896:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321900:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.321903:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321909:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321917:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346900) 00010000:00010000:0.0:1788664338.321920:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.321923:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321928:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be907e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321943:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321957:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321963:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321968:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.321971:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321977:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321985:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:0.0:1788664338.321988:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.321990:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.321996:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be907e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.322549:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+27:10497:x1875550204376192:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1495us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664338.322559:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:2.0:1788664338.383330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.383636:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204376448 00000100:00100000:3.0:1788664338.383646:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204376448 00000100:00100000:3.0:1788664338.383746:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:3.0:1788664338.383756:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+27:10501:x1875550204376448:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664338.383778:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664338.383799:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be907ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243854 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.383895:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.383910:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.383921:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.383936:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.383943:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.383963:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.384271:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.384280:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.384286:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664338.384296:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788664338.384425:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.384434:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.384441:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.384446:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664338.384451:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385571:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385593:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:3.0:1788664338.385596:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664338.385601:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385623:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be907f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385640:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385646:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385652:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385657:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664338.385660:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385667:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385673:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811a00) 00010000:00010000:3.0:1788664338.385676:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664338.385679:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385685:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be907fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385752:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be907ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243854 expref: 30 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385766:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243854 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.385779:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:3.0:1788664338.385782:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788664338.385785:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147ac00, rc 0) 00000100:00100000:3.0:1788664338.385853:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+29:10501:x1875550204376448:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2098us (2533us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788664338.385861:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:2.0:1788664338.394232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.394388:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204376576 00000100:00100000:0.0:1788664338.394398:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204376576 00000100:00100000:0.0:1788664338.394477:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:0.0:1788664338.394487:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+29:10501:x1875550204376576:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:0.0:1788664338.394563:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.394591:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 29 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.394601:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.394636:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 29 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.394651:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 29 pid: 7653 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.394666:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d52300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222224256:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664338.394754:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664338.401747:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d52300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222224256:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664338.401780:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.407185:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664338.411157:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204376832 00000100:00100000:1.0:1788664338.411173:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204376832 00000100:00100000:1.0:1788664338.411680:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:1.0:1788664338.411694:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+30:5600:x1875550204376832:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788664338.412059:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:5600:x1875550204376832:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 359us (4875us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788664338.412067:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:3.0:1788664338.415915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.416062:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204376960 00000100:00100000:2.0:1788664338.416072:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204376960 00010000:00010000:2.0:1788664338.416118:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 31 pid: 7653 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.416209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:2.0:1788664338.416220:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:2361:x1875550204376960:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664338.416239:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664338.416247:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 31 pid: 7653 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.416260:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 31 pid: 7653 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.416283:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be907b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24383f expref: 31 pid: 7653 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.416301:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:2.0:1788664338.416307:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.416331:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.416377:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.416410:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664338.418160:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+30:2361:x1875550204376960:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1931us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664338.418173:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00010000:00010000:1.0:1788664338.418272:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418283:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418320:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418327:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418334:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418356:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664338.418361:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418389:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418404:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:1.0:1788664338.418407:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664338.418412:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.418418:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664338.418497:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+29:10501:x1875550204376576:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 24011us (24275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664338.418505:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:0.0:1788664338.437228:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.437840:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204377216 00000100:00100000:3.0:1788664338.437851:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204377216 00000100:00100000:3.0:1788664338.437911:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:3.0:1788664338.437922:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+29:10501:x1875550204377216:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664338.438201:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+30:10501:x1875550204377216:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 272us (974us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788664338.438209:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:3.0:1788664338.556864:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.557968:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204377472 00000100:00100000:0.0:1788664338.557982:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204377472 00000100:00100000:0.0:1788664338.558400:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:0.0:1788664338.558415:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+30:10512:x1875550204377472:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:0.0:1788664338.559093:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664338.559122:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90818 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24385b expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.559820:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.559839:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.559852:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.559869:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.559876:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.559884:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.563874:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be9082d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.563898:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be9082d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.563911:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be9082d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664338.563941:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788664338.565694:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565721:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565742:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565748:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.565753:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565762:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565776:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664338.565779:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.565784:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565791:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be9081f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565805:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565811:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565817:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565822:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.565825:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565841:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565850:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346900) 00010000:00010000:0.0:1788664338.565853:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.565856:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565862:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565940:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24385b expref: 33 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565963:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be9082d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24385b expref: 32 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.565970:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:0.0:1788664338.565972:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664338.565975:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664338.566301:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+32:10512:x1875550204377472:12345-192.168.202.14@tcp:101:cat.0 Request processed in 7888us (9446us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788664338.566312:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:2.0:1788664338.572827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.572919:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204377728 00000100:00100000:3.0:1788664338.572937:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204377728 00000100:00100000:3.0:1788664338.572993:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:3.0:1788664338.573003:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+32:10512:x1875550204377728:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:3.0:1788664338.573398:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+33:10512:x1875550204377728:12345-192.168.202.14@tcp:35:cat.0 Request processed in 396us (580us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788664338.573406:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:2.0:1788664338.607611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.607770:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204377984 00000100:00100000:0.0:1788664338.607781:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204377984 00000100:00100000:0.0:1788664338.607848:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:0.0:1788664338.607860:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+33:10513:x1875550204377984:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:0.0:1788664338.607948:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788664338.607975:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be9082d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24385b expref: 33 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.607999:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243854 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608029:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be907cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243846 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608040:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:0.0:1788664338.608051:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664338.608073:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608087:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608097:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608113:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608119:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608125:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608729:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608739:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.608747:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664338.610796:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1788664338.610809:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372594466508ns, next at 373594463255ns, rc = 0 00010000:00010000:0.0:1788664338.610877:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610893:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610905:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610914:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610921:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610928:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610955:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664338.610976:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610990:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.610997:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611003:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.611008:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611032:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611044:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:0.0:1788664338.611047:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788664338.611052:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611059:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90849 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611080:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611086:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611091:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611096:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.611106:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611113:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611120:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664338.611123:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664338.611126:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.611132:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9083b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664338.611142:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025321f39 reply state 000000009bc92a23 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.611151:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664338.611253:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+32:10513:x1875550204377984:12345-192.168.202.14@tcp:36:rm.0 Request processed in 3392us (3649us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788664338.611262:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 95 00010000:00010000:2.0:1788664338.612060:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664338.612069:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.612077:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efe00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664338.612081:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.612089:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.612100:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664338.612103:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664338.612107:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.612113:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90850 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.612145:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664338.612146:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664338.612148:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664338.613994:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.614036:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.614044:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.614050:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664338.614055:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.614063:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.614077:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346900) 00010000:00010000:3.0:1788664338.614080:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664338.614084:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.614090:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90842 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.673888:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.674104:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204378240 00000100:00100000:3.0:1788664338.674116:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204378240 00000100:00100000:3.0:1788664338.674191:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:3.0:1788664338.674214:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:10519:x1875550204378240:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788664338.674241:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664338.674263:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90857 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243862 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.674448:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.674464:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.674475:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.674491:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.674499:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.674507:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664338.676239:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788664338.676421:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676434:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676444:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676478:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676485:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676492:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676498:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664338.676502:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676509:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676520:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664338.676528:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664338.676534:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676540:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be9085e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664338.676556:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032786b5c reply state 000000003fbb2a62 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.676564:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788664338.676599:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90857 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676611:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.676618:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9affa00) 00010000:00010000:2.0:1788664338.676621:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664338.676623:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eba00, rc 0) 00000100:00100000:2.0:1788664338.676698:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+34:10519:x1875550204378240:12345-192.168.202.14@tcp:101:bash.0 Request processed in 2497us (2819us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788664338.676706:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 96 00010000:00010000:1.0:1788664338.682420:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.682441:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.682449:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.682455:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664338.682460:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.682467:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.682501:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811a00) 00010000:00010000:1.0:1788664338.682504:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664338.682509:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.682515:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a400/0x762f55027be90865 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.696446:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.696534:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204378368 00000100:00100000:0.0:1788664338.696544:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204378368 00000100:00100000:0.0:1788664338.696626:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:0.0:1788664338.696637:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204378368:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664338.696656:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664338.696680:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243869 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664338.696719:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788664338.696754:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788664338.696759:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664338.696779:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.696799:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.696813:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efc00, rc 0) 00000100:00100000:0.0:1788664338.696878:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204378368:12345-192.168.202.14@tcp:101:bash.0 Request processed in 243us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664338.696886:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00080000:2.0:1788664338.697582:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664338.700959:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.701198:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204378496 00000100:00100000:0.0:1788664338.701208:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204378496 00000100:00100000:0.0:1788664338.701270:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:0.0:1788664338.701281:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:10519:x1875550204378496:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664338.701300:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664338.701320:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243870 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.701399:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.701409:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664338.701414:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664338.701420:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.701467:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.701482:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 7 pid: 6696 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.701497:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875550222224384:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664338.701606:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664338.704516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.704715:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204378624 00000100:00100000:2.0:1788664338.704725:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204378624 00010000:00010000:2.0:1788664338.704767:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 8 pid: 6696 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.704830:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788664338.704841:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5892050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204378624:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664338.704858:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664338.704882:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 8 pid: 6696 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.704896:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 8 pid: 6696 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.704921:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664338.704926:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664338.704935:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.704945:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.704981:0:7644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.704997:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7644:1875550222224512:192.168.202.14@tcp:105: 00000100:00100000:2.0:1788664338.705109:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331240 going to sleep for 11 seconds 00010000:00010000:0.0:1788664338.705838:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001262a6e6/0x762f55027be9087a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243869 expref: 8 pid: 6696 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.705856:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875550222224384:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664338.705881:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.705893:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664338.705937:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:10519:x1875550204378496:12345-192.168.202.14@tcp:101:bash.0 Request processed in 4658us (4989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664338.705946:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788664338.707798:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ac000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7644:1875550222224512:192.168.202.14@tcp:105: 00010000:00010000:2.0:1788664338.707839:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664338.707891:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5892050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204378624:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 3051us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664338.707903:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:2.0:1788664338.709557:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.709672:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204378880 00000100:00100000:3.0:1788664338.709682:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204378880 00000100:00100000:3.0:1788664338.709767:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:3.0:1788664338.709777:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+33:10519:x1875550204378880:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:3.0:1788664338.710165:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+34:10519:x1875550204378880:12345-192.168.202.14@tcp:35:bash.0 Request processed in 389us (616us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788664338.710172:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000001:00080000:0.0:1788664338.792403:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788664338.849529:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.849609:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204379008 00000100:00100000:2.0:1788664338.849621:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204379008 00000100:00100000:2.0:1788664338.849695:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:2.0:1788664338.849705:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+34:10535:x1875550204379008:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664338.849731:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664338.849755:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90888 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243877 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.849839:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9088f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.849854:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9088f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.849866:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9088f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664338.849906:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788664338.849911:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664338.849934:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9088f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.849964:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90888 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243877 expref: 36 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.850016:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9088f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243877 expref: 35 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.850025:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664338.850028:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664338.850032:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eaa00, rc 0) 00000100:00100000:2.0:1788664338.850106:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+35:10535:x1875550204379008:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 402us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664338.850114:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:1.0:1788664338.857092:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.857208:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204379264 00000100:00100000:0.0:1788664338.857218:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204379264 00000100:00100000:0.0:1788664338.857328:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:0.0:1788664338.857382:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+35:10535:x1875550204379264:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664338.857434:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664338.857457:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90896 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24387e expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.857597:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9089d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.857613:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9089d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.857626:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9089d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664338.857640:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788664338.857790:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90896 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24387e expref: 38 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.857810:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9089d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24387e expref: 37 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.857819:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9affa00) 00010000:00010000:0.0:1788664338.857822:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664338.857826:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef400, rc 0) 00000100:00100000:0.0:1788664338.857894:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+37:10535:x1875550204379264:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 556us (812us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788664338.857902:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:3.0:1788664338.864631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.865009:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204379520 00000100:00100000:2.0:1788664338.865020:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204379520 00000100:00100000:2.0:1788664338.865087:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:2.0:1788664338.865099:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+37:10535:x1875550204379520:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664338.865125:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664338.865146:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be908ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243885 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.865264:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be908b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.865280:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be908b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.865293:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be908b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664338.865308:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788664338.865633:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be908ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243885 expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.865651:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be908b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243885 expref: 39 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.865660:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9affa00) 00010000:00010000:2.0:1788664338.865664:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788664338.865668:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea200, rc 0) 00000100:00100000:2.0:1788664338.865724:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+39:10535:x1875550204379520:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 628us (1111us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788664338.865732:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:3.0:1788664338.871563:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.871830:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204379648 00000100:00100000:0.0:1788664338.871842:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204379648 00000100:00100000:0.0:1788664338.871912:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788664338.871939:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+39:2358:x1875550204379648:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664338.871957:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664338.871982:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9089d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24387e expref: 39 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.872076:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9affa00) 00010000:00010000:0.0:1788664338.872082:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664338.872143:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+38:2358:x1875550204379648:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 206us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664338.872151:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:1.0:1788664338.887215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664338.887279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664338.887317:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.887800:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204379904 00000100:00100000:2.0:1788664338.887815:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204379904 00000100:00100000:2.0:1788664338.887887:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204380032 00000100:00100000:2.0:1788664338.887890:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204380032 00000100:00100000:2.0:1788664338.887943:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:2.0:1788664338.887953:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204379904:12345-192.168.202.14@tcp:16:kworker.0 00000100:00100000:2.0:1788664338.888118:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204379904:12345-192.168.202.14@tcp:16:kworker.0 Request processed in 166us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664338.888126:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:2.0:1788664338.888146:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:2.0:1788664338.888152:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204380032:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:2.0:1788664338.888182:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.888203:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.888219:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664338.888224:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664338.888229:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.888265:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.888280:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 6 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664338.888290:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204379776 00000100:00100000:2.0:1788664338.888293:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875550222224640:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664338.888294:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204379776 00002000:00100000:3.0:1788664338.888321:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b68f8cef480 x1875550204379776/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:644/0 lens 504/0 e 0 to 0 dl 1788664349 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664338.888330:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8cef480 with x1875550204379776 ext(0->8) 00010000:00010000:3.0:1788664338.888336:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 7 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.888375:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 7 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664338.888377:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c93310c0 going to sleep for 11 seconds 00002000:00010000:3.0:1788664338.888383:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68f8cef480 00000100:00100000:3.0:1788664338.888418:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:3.0:1788664338.888425:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204379776:12345-192.168.202.14@tcp:4:bash.0 00000100:00100000:3.0:1788664338.890071:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2358:x1875550204379776:12345-192.168.202.14@tcp:4:bash.0 Request processed in 1638us (2783us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788664338.890082:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00002000:00100000:3.0:1788664338.890255:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b68f8cef480 x1875550204379776/t4294967302(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:644/0 lens 504/448 e 0 to 0 dl 1788664349 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664338.890265:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8cef480 with x1875550204379776 ext(0->8) 00010000:00010000:3.0:1788664338.890275:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.890293:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664338.890309:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68f8cef480 00000100:00100000:2.0:1788664338.902488:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875550222224640:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664338.902527:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664338.902921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664338.903092:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204380160 00000100:00100000:1.0:1788664338.903101:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204380160 00010000:00010000:1.0:1788664338.903153:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664338.903192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788664338.903203:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2361:x1875550204380160:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664338.903219:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788664338.903240:0:5841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788664338.903243:0:5841:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788664339 00002000:00010000:1.0:1788664338.903245:0:5841:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788664339 00010000:00010000:1.0:1788664338.903252:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.903266:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.903309:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243870 expref: 9 pid: 6697 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.903330:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664338.903335:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664338.903401:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.903413:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.903437:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664338.903844:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903856:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903893:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903903:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903912:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903919:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664338.903932:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903942:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903956:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.903963:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be908c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.904053:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204380032:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 15899us (16733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664338.904061:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:1.0:1788664338.904387:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204380160:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1185us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664338.904395:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:3.0:1788664338.913274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664338.915852:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204380416 00000100:00100000:0.0:1788664338.915868:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204380416 00000100:00100000:0.0:1788664338.915964:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:0.0:1788664338.915976:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+38:10535:x1875550204380416:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:0.0:1788664338.916061:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be908b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243885 expref: 38 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664338.916692:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788664338.916741:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788664338.917097:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788664338.917733:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.917768:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.917779:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.917826:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.917842:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 42 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.917858:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5857:1875550222224768:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664338.918004:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664338.929427:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.929800:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204380544 00000100:00100000:3.0:1788664338.929809:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204380544 00010000:00010000:3.0:1788664338.929862:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 43 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664338.929912:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788664338.929924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+43:2361:x1875550204380544:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664338.929943:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664338.929950:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 43 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.929965:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 43 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.930001:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9affa00) 00010000:00010000:3.0:1788664338.930009:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.930020:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.930029:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664338.930074:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664338.930153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+43:2361:x1875550204380544:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 230us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664338.930160:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00010000:00010000:1.0:1788664338.930718:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9086c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243862 expref: 42 pid: 5854 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664338.930739:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5857:1875550222224768:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664338.930764:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.930775:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664338.930780:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664338.930933:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788664338.931178:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788664338.931316:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8ceed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222224896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664338.932201:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664338.932257:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eeacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664338.932441:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222224896 00000100:00100000:3.0:1788664338.932452:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222224896 00000100:00100000:3.0:1788664338.932830:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664338.932843:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222224896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788664338.933040:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222224896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 200us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664338.933050:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664338.933305:0:5857:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788664338.933313:0:5857:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788664338.933378:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68f8cef100, transno 4294967301 00000100:00100000:0.0:1788664338.933396:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8ceed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222224896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788664338.933991:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788664338.934094:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d53100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222225024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788664338.934170:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664338.934209:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664338.934250:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222225024 00000100:00100000:0.0:1788664338.934259:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222225024 00000100:00100000:0.0:1788664338.934298:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664338.934314:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222225024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788664338.934551:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5857:x1875550222225024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 237us (381us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788664338.934558:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664338.934602:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d53100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222225024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788664338.934654:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788664338.934692:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.934703:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.934711:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.934719:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664338.934724:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.934733:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.934751:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9affa00) 00010000:00010000:0.0:1788664338.934754:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788664338.934760:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664338.934767:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be908c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664338.934967:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788664338.935103:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788664338.935115:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372918772298ns, next at 373918770143ns, rc = 0 00000001:00080000:0.0:1788664338.935120:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788664338.935152:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9affa00) 00010000:00010000:0.0:1788664338.935156:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788664338.935163:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be908b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243885 expref: 46 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664338.935270:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+45:10535:x1875550204380416:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 19297us (22011us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788664338.935277:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000020:00080000:0.0:1788664338.935281:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788664338.935918:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664338.940271:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664338.940381:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204380672 00000100:00100000:2.0:1788664338.940391:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204380672 00000100:00100000:2.0:1788664338.940448:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:2.0:1788664338.940468:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+45:10535:x1875550204380672:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664338.940496:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664338.940521:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be908ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24388c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.940607:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be908ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24388c expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.940622:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be908ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24388c expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664338.940645:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664338.940648:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664338.940652:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eba00, rc 0) 00000100:00100000:2.0:1788664338.940715:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+46:10535:x1875550204380672:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 258us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664338.940723:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:2.0:1788664338.957467:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664338.957601:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204380928 00000100:00100000:3.0:1788664338.957611:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204380928 00000100:00100000:3.0:1788664338.957665:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:3.0:1788664338.957676:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+46:10535:x1875550204380928:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664338.958016:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10535:x1875550204380928:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 341us (569us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788664338.958024:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:3.0:1788664339.080929:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664339.081085:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204381056 00000100:00100000:2.0:1788664339.081096:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204381056 00000100:00100000:2.0:1788664339.081163:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:2.0:1788664339.081174:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10545:x1875550204381056:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:2.0:1788664339.081273:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081300:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081323:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081387:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081421:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081430:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081550:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081559:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081566:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664339.081618:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081631:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081638:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081644:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081650:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664339.081654:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081662:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081680:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664339.081684:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664339.081690:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081696:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081712:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081719:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081724:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081729:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664339.081732:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081746:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081754:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e9afff00) 00010000:00010000:2.0:1788664339.081756:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664339.081759:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081765:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081793:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081800:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081805:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081810:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664339.081812:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081819:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081834:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.081837:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664339.081840:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.081846:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664339.081963:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10545:x1875550204381056:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 779us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664339.081972:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:1.0:1788664339.143863:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664339.143981:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204381312 00000100:00100000:2.0:1788664339.143993:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204381312 00000100:00100000:2.0:1788664339.144059:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:2.0:1788664339.144080:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+47:10548:x1875550204381312:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664339.144114:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664339.144134:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243893 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144232:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144249:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144261:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144276:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144283:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144290:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144462:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be908ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144483:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be908ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144491:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be908ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664339.144514:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788664339.144866:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144876:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144884:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144892:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664339.144897:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144906:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144918:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664339.144922:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664339.144927:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144934:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be908f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144958:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144965:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144983:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144988:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664339.144992:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.144999:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.145010:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e9afff00) 00010000:00010000:2.0:1788664339.145012:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664339.145015:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.145021:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be908f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.145072:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be908ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243893 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.145086:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be908ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243893 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.145156:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.145160:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664339.145163:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb200, rc 0) 00000100:00100000:2.0:1788664339.145235:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+49:10548:x1875550204381312:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1157us (1395us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788664339.145252:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:3.0:1788664339.152870:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664339.152993:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204381440 00000100:00100000:2.0:1788664339.153004:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204381440 00000100:00100000:2.0:1788664339.153063:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:2.0:1788664339.153073:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+49:10548:x1875550204381440:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788664339.153146:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153163:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153173:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153202:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153209:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153215:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153222:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664339.153226:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153234:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153244:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.153260:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664339.153266:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.153272:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be9090d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664339.153801:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+49:10548:x1875550204381440:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 727us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664339.153811:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:1.0:1788664339.162235:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664339.162314:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204381696 00000100:00100000:3.0:1788664339.162325:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204381696 00000100:00100000:3.0:1788664339.162610:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:3.0:1788664339.162686:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+49:10548:x1875550204381696:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664339.163974:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+50:10548:x1875550204381696:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 1289us (1745us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788664339.163996:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:0.0:1788664339.231792:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222225152:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.231870:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664339.231921:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222225664:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.231972:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664339.231994:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788664339.231999:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222225536:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232020:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664339.232041:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222225408:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232060:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664339.232074:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788664339.232078:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222225280:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664339.232120:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222225792:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232159:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664339.232187:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222225536 00000100:00100000:0.0:1788664339.232193:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222225536 00000100:00100000:0.0:1788664339.232237:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222225792 00000100:00100000:0.0:1788664339.232240:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222225792 00000100:00100000:0.0:1788664339.232254:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788664339.232262:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222225536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232312:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222225536:12345-0@lo:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664339.232319:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788664339.232335:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664339.232382:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222225792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232742:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222225792:12345-0@lo:400:kworker.0 Request processed in 401us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664339.232748:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664339.232790:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222225792:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232817:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222225536:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232842:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222225664 00000100:00100000:0.0:1788664339.232846:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222225664 00000100:00100000:0.0:1788664339.232873:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222225408 00000100:00100000:0.0:1788664339.232876:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222225408 00000100:00100000:0.0:1788664339.232887:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222225280 00000100:00100000:0.0:1788664339.232889:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222225280 00000100:00100000:0.0:1788664339.232899:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788664339.232906:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222225664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.232957:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222225664:12345-0@lo:400:kworker.0 Request processed in 51us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664339.232974:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788664339.232988:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788664339.232993:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222225408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.233024:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222225408:12345-0@lo:400:kworker.0 Request processed in 31us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664339.233030:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788664339.233041:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788664339.233046:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222225280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.233069:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222225280:12345-0@lo:400:kworker.0 Request processed in 23us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664339.233075:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788664339.233227:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222225280:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.233236:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222225408:0@lo:400:kworker.0 00000100:00100000:0.0:1788664339.233258:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222225664:0@lo:400:kworker.0 00000100:00100000:1.0:1788664339.233385:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222225152 00000100:00100000:1.0:1788664339.233390:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222225152 00000100:00100000:1.0:1788664339.233416:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788664339.233423:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222225152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664339.233474:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222225152:12345-0@lo:400:kworker.0 Request processed in 52us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664339.233480:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788664339.233518:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222225152:0@lo:400:kworker.0 00010000:00010000:3.0:1788664339.233785:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664339.233851:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664339.233858:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664339.342463:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664339.342641:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204381952 00000100:00100000:0.0:1788664339.342655:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204381952 00000100:00100000:0.0:1788664339.342732:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:0.0:1788664339.342744:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+50:10558:x1875550204381952:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664339.342775:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664339.342779:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788664339.342821:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be9088f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243877 expref: 50 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.342844:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664339.342866:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664339.342881:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90914 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24389a expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.343007:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be9091b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.343021:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be9091b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.343031:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be9091b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664339.343044:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788664339.343288:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90914 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24389a expref: 52 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.343299:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be9091b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24389a expref: 51 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.343304:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:0.0:1788664339.343306:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664339.343308:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef200, rc 0) 00000100:00100000:0.0:1788664339.343488:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+51:10558:x1875550204381952:12345-192.168.202.14@tcp:101:bash.0 Request processed in 745us (1217us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788664339.343496:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:2.0:1788664339.362694:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664339.362752:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664339.362960:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204382080 00000100:00100000:1.0:1788664339.362971:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204382080 00000100:00100000:1.0:1788664339.363048:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788664339.363061:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+51:2358:x1875550204382080:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664339.363094:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664339.363118:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be9091b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24389a expref: 51 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.363139:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664339.363159:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664339.363233:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+50:2358:x1875550204382080:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 175us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664339.363242:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788664339.371242:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204382336 00000100:00100000:3.0:1788664339.371262:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204382336 00000100:00100000:2.0:1788664339.372050:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:2.0:1788664339.372062:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+50:10558:x1875550204382336:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:2.0:1788664339.372258:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664339.372295:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be908ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243893 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.372584:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.372593:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664339.373740:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.373765:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.373777:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664339.374279:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788664339.374927:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000395e478a reply state 0000000098a201f5 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664339.374942:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664339.375135:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10558:x1875550204382336:12345-192.168.202.14@tcp:36:bash.0 Request processed in 3071us (12377us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788664339.375145:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 105 00000020:00080000:2.0:1788664339.375151:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788664339.384170:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664339.384543:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204382464 00000100:00100000:0.0:1788664339.384553:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204382464 00000100:00100000:0.0:1788664339.384616:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:0.0:1788664339.384625:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10558:x1875550204382464:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664339.384662:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664339.384685:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438a1 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.384784:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.384796:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.384804:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.384829:0:7653:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.384840:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391478:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391500:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391508:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391516:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664339.391522:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391532:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391551:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:3.0:1788664339.391876:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664339.391882:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391893:0:3294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664339.391901:0:3294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.392960:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.392973:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90929 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.393023:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.393031:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664339.393172:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788664339.393178:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664339.393204:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.393246:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 53 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.393263:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 52 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.393272:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.393275:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664339.393291:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efe00, rc 0) 00000100:00100000:2.0:1788664339.393476:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10558:x1875550204382464:12345-192.168.202.14@tcp:101:bash.0 Request processed in 8850us (9314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664339.393486:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 106 00000100:00100000:1.0:1788664339.397452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664339.397543:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204382720 00000100:00100000:0.0:1788664339.397565:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204382720 00000100:00100000:0.0:1788664339.397623:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:0.0:1788664339.397632:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+52:10558:x1875550204382720:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:0.0:1788664339.397883:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+53:10558:x1875550204382720:12345-192.168.202.14@tcp:35:bash.0 Request processed in 251us (553us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788664339.397903:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:1.0:1788664339.465628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664339.465869:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204382848 00000100:00100000:0.0:1788664339.465880:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204382848 00000100:00100000:0.0:1788664339.466012:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:0.0:1788664339.466023:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+53:10564:x1875550204382848:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664339.466047:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664339.466068:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9093e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438a8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.466136:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.466149:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.466160:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664339.466196:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788664339.466200:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664339.466218:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.466247:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9093e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a8 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.466265:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a8 expref: 54 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.466292:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664339.466295:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664339.466298:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efa00, rc 0) 00000100:00100000:0.0:1788664339.466424:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10564:x1875550204382848:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 403us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664339.466430:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:2.0:1788664339.472419:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664339.472607:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204382976 00000100:00100000:0.0:1788664339.472617:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204382976 00000100:00100000:0.0:1788664339.472671:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:0.0:1788664339.472679:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10564:x1875550204382976:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664339.472697:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664339.472713:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9094c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438af expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472767:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472777:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472785:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472794:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472799:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472817:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472886:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472891:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472895:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664339.472942:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788664339.472948:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664339.472968:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472981:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.472990:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475265:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475278:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475285:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664339.475291:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475433:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475448:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:0.0:1788664339.475452:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664339.475456:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475552:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475749:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475756:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475762:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475768:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664339.475772:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475777:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475785:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68e1346600) 00010000:00010000:0.0:1788664339.475788:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664339.475791:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475818:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be9095a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475872:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9094c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475887:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664339.475895:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:0.0:1788664339.475897:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664339.475912:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efc00, rc 0) 00000100:00100000:0.0:1788664339.475979:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10564:x1875550204382976:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 3299us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664339.475989:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:3.0:1788664339.479442:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664339.479635:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204383232 00000100:00100000:2.0:1788664339.479647:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204383232 00000100:00100000:2.0:1788664339.479710:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:2.0:1788664339.479721:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10564:x1875550204383232:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664339.479744:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664339.479766:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438b6 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.479876:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.479891:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 56 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.479911:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.479920:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.479954:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.479968:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 56 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664339.479987:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222225920:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664339.480234:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 56 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.480244:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 56 pid: 7653 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664339.480254:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222226048:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664339.480281:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c93316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664339.482620:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:2.0:1788664339.482767:0:5856:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.14@tcp) returned -22 from blocking AST (req@00000000aa0b62c4 x1875550222225920) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 56 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.482788:0:5856:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 56 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.482813:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438af expref: 56 pid: 5855 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664339.482827:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222225920:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664339.482841:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222226048:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664339.482862:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.482868:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.482894:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.482914:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664339.483007:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204383360 00000100:00100000:3.0:1788664339.483014:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204383360 00000100:00100000:3.0:1788664339.483076:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788664339.483086:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+56:2358:x1875550204383360:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664339.483099:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664339.483102:0:5842:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 762f55027be90961) 00010000:00010000:3.0:1788664339.483104:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664339.483153:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+56:2358:x1875550204383360:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 69us (542us total) trans 0 rc 116/116 00000100:00100000:3.0:1788664339.483161:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788664339.484111:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664339.484182:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204383488 00000100:00100000:1.0:1788664339.484188:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204383488 00010000:00010000:1.0:1788664339.484213:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 56 pid: 7653 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664339.484246:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:1.0:1788664339.484254:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+56:2361:x1875550204383488:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664339.484265:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664339.484271:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 56 pid: 7653 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.484283:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 56 pid: 7653 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.484299:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a1 expref: 56 pid: 7653 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.484312:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664339.484316:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.484336:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.484382:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.484405:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664339.484438:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+55:2361:x1875550204383488:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 185us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664339.484445:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00010000:00010000:2.0:1788664339.484552:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.484560:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664339.484578:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788664339.484722:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 56 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.484738:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.484746:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.484749:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664339.484751:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eac00, rc 0) 00000100:00100000:2.0:1788664339.484777:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10564:x1875550204383232:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 5059us (5345us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788664339.484784:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:1.0:1788664339.489171:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664339.489645:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204383744 00000100:00100000:3.0:1788664339.489656:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204383744 00000100:00100000:2.0:1788664339.489913:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788664339.489924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10564:x1875550204383744:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:2.0:1788664339.489939:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664339.489975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be908ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24388c expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.489993:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664339.489998:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664339.490140:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5893c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10564:x1875550204383744:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 218us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664339.490149:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788664339.493519:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664339.493679:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204383872 00000100:00100000:2.0:1788664339.493689:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204383872 00000100:00100000:2.0:1788664339.493733:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00100000:2.0:1788664339.493742:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10564:x1875550204383872:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:2.0:1788664339.493875:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.493892:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664339.493913:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664339.494233:0:7653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788664339.494316:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10564:x1875550204383872:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 574us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664339.494324:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00100000:3.0:1788664339.498233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664339.499252:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204384000 00000100:00100000:0.0:1788664339.499265:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204384000 00000100:00100000:1.0:1788664339.499699:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 111 00000100:00100000:1.0:1788664339.499711:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+54:10564:x1875550204384000:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664339.499732:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664339.499755:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438bd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.499828:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.499841:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.499861:0:5854:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.499874:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.499921:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664339.499924:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788664339.499929:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664339.499937:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478600, rc 0) 00000100:00100000:1.0:1788664339.500002:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10564:x1875550204384000:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 295us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664339.500011:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 111 00000100:00100000:2.0:1788664339.744720:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664339.744745:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222226176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664339.744817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664339.744969:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222226176 00000100:00100000:3.0:1788664339.744978:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222226176 00000100:00100000:3.0:1788664339.745026:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788664339.745051:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222226176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664339.745078:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664339.745129:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222226176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664339.745137:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788664339.745257:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222226176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788664340.255597:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664340.319649:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664340.319660:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664340.319725:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788664340.319733:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664340.319919:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ae680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222226304:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664340.320109:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788664340.323873:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.323928:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ae680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222226304:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664340.324313:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204384128 00000100:00100000:0.0:1788664340.324322:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204384128 00000100:00100000:0.0:1788664340.324434:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:0.0:1788664340.324446:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10565:x1875550204384128:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788664340.324479:0:5855:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788664340.324595:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10565:x1875550204384128:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 151us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.324605:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00080000:2.0:1788664340.324790:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664340.327914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.328165:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204384256 00000100:00100000:2.0:1788664340.328174:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204384256 00000100:00100000:2.0:1788664340.328229:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:2.0:1788664340.328236:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10565:x1875550204384256:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788664340.328439:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.328457:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.328481:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.333816:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.333841:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.333856:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.333911:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.333922:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.333929:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664340.336438:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788664340.336445:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664340.336464:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336478:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336486:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336493:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336553:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eba00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664340.336559:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336568:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336583:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:2.0:1788664340.336601:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664340.336607:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336613:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9098b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336630:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336635:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336641:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336645:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664340.336648:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336653:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336660:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b68e9afff00) 00010000:00010000:2.0:1788664340.336662:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664340.336665:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336671:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90992 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336748:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336762:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336768:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336774:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664340.336777:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336792:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336801:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664340.336803:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664340.336806:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.336812:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.337085:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10565:x1875550204384256:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 8843us (9174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664340.337096:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:3.0:1788664340.344891:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.351334:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204384512 00000100:00100000:1.0:1788664340.351412:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204384512 00000100:00100000:1.0:1788664340.351506:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 114 00000100:00100000:1.0:1788664340.351517:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+55:10565:x1875550204384512:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664340.351540:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664340.351563:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be909a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438c4 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351685:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351701:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351713:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664340.351747:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788664340.351860:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351868:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351875:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351880:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664340.351884:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351893:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351906:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664340.351909:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788664340.351914:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351920:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351972:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be909a0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438c4 expref: 57 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.351983:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:1.0:1788664340.351986:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664340.351998:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be909a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438c4 expref: 57 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.352008:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478200, rc 0) 00000100:00100000:1.0:1788664340.352076:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+56:10565:x1875550204384512:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 561us (7195us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788664340.352085:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 114 00000100:00100000:3.0:1788664340.355657:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.355742:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204384640 00000100:00100000:1.0:1788664340.355752:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204384640 00000100:00100000:1.0:1788664340.355849:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:1.0:1788664340.355858:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+56:10565:x1875550204384640:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664340.355894:0:5854:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664340.356087:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+56:10565:x1875550204384640:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 230us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664340.356094:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 115 00000100:00100000:3.0:1788664340.363505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.363674:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204384896 00000100:00100000:2.0:1788664340.363684:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204384896 00000100:00100000:2.0:1788664340.363743:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:2.0:1788664340.363751:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+56:10565:x1875550204384896:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664340.363772:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664340.363797:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788664340.363832:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438a8 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.363853:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664340.363859:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664340.363871:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be909b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438cb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664340.365194:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788664340.365751:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be909bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.365765:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be909bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.365788:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be909bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.365851:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be909b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438cb expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.366448:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be909bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438cb expref: 57 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.366458:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68e9afff00) 00010000:00010000:2.0:1788664340.366461:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664340.366464:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb200, rc 0) 00000100:00100000:3.0:1788664340.366877:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+57:10565:x1875550204384896:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3123us (3388us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788664340.366900:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 116 00000100:00100000:3.0:1788664340.378417:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.379649:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204385152 00000100:00100000:2.0:1788664340.379662:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204385152 00000100:00100000:2.0:1788664340.379803:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:2.0:1788664340.379814:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+57:10565:x1875550204385152:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664340.379877:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664340.379906:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be909bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438cb expref: 57 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.379940:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68e9afff00) 00010000:00010000:2.0:1788664340.379960:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664340.379984:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.379999:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380010:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380023:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380029:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380036:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380099:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380107:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380125:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380143:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664340.380148:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380156:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380165:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664340.380169:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664340.380173:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380179:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be909ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380189:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380196:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380201:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380206:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eaa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664340.380209:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380225:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380233:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x30235a00 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664340.380236:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664340.380239:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.380244:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x30235a00 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.380373:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+56:10565:x1875550204385152:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 561us (2241us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664340.380381:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 117 00000100:00100000:2.0:1788664340.386124:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.387105:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204385280 00000100:00100000:1.0:1788664340.387117:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204385280 00000100:00100000:1.0:1788664340.387198:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:1.0:1788664340.387209:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+56:10565:x1875550204385280:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664340.387236:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664340.387271:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be909d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438d2 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.387314:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.387326:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.387708:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.391686:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be909d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 58 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.391732:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 57 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.391742:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:0.0:1788664340.391746:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788664340.391749:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479a00, rc 0) 00000100:00100000:0.0:1788664340.391839:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+57:10565:x1875550204385280:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 4630us (5725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.391848:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 118 00000100:00100000:1.0:1788664340.398105:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.398158:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204385536 00000100:00100000:2.0:1788664340.398169:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204385536 00000100:00100000:2.0:1788664340.398231:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:2.0:1788664340.398241:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+57:10565:x1875550204385536:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664340.398333:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.398702:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.398716:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664340.399076:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1788664340.399087:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374382745070ns, next at 375382742238ns, rc = 0 00000004:00010000:3.0:1788664340.399428:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001234e1bb reply state 000000000c8ac15b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664340.399439:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664340.399546:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+59:10565:x1875550204385536:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 1305us (1452us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788664340.399555:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 119 00000100:00100000:3.0:1788664340.404324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788664340.407163:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.407182:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.407190:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.407270:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eaa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664340.407277:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.407286:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.407305:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:1.0:1788664340.407308:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788664340.407313:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.407320:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be909e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.407554:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204385664 00000100:00100000:0.0:1788664340.407562:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204385664 00000100:00100000:0.0:1788664340.407617:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:0.0:1788664340.407624:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+58:10565:x1875550204385664:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664340.407646:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664340.407659:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438d9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.407810:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.407823:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.407843:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:0.0:1788664340.407845:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664340.407861:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef800, rc 0) 00000100:00100000:0.0:1788664340.408101:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+59:10565:x1875550204385664:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 475us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.408110:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 120 00000100:00100000:2.0:1788664340.412636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.412823:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204385792 00000100:00100000:0.0:1788664340.412836:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204385792 00000100:00100000:0.0:1788664340.413152:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:0.0:1788664340.413164:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2359:x1875550204385792:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788664340.413634:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2359:x1875550204385792:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 469us (1005us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788664340.413643:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:3.0:1788664340.416657:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.417307:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204386048 00000100:00100000:0.0:1788664340.417327:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204386048 00000100:00100000:0.0:1788664340.417413:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:0.0:1788664340.417423:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c9337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+59:10565:x1875550204386048:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788664340.417742:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c9337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+60:10565:x1875550204386048:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 319us (1092us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788664340.417751:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:3.0:1788664340.421446:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.421652:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204386304 00000100:00100000:0.0:1788664340.421663:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204386304 00000100:00100000:0.0:1788664340.421720:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:0.0:1788664340.421730:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+60:10565:x1875550204386304:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788664340.421876:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+60:10565:x1875550204386304:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 147us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.421884:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 121 00000100:00100000:1.0:1788664340.425574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.425743:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204386432 00000100:00100000:0.0:1788664340.425752:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204386432 00000100:00100000:0.0:1788664340.425820:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:0.0:1788664340.425830:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+60:10565:x1875550204386432:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664340.425849:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664340.425870:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be909f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438e0 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.426035:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be909fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.426050:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be909fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.426061:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be909fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664340.426107:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664340.426293:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be909fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.426327:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be909f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e0 expref: 62 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.426375:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be909fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e0 expref: 61 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.426384:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:0.0:1788664340.426387:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788664340.426391:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef600, rc 0) 00000100:00100000:0.0:1788664340.426472:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+61:10565:x1875550204386432:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 643us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.426479:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00080000:2.0:1788664340.428619:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664340.435678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.435785:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204386560 00000100:00100000:0.0:1788664340.435796:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204386560 00000100:00100000:0.0:1788664340.435863:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:0.0:1788664340.435873:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204386560:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664340.435895:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664340.435934:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438e7 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664340.436078:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cda15, blocks: 0x1 00010000:00010000:0.0:1788664340.436104:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1788664340.436109:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664340.436120:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.436151:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 10 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.436166:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee600, rc 0) 00000100:00100000:0.0:1788664340.436564:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+10:2360:x1875550204386560:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 690us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.436573:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:1.0:1788664340.440708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.440874:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204386816 00000100:00100000:0.0:1788664340.440884:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204386816 00000100:00100000:0.0:1788664340.441170:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:0.0:1788664340.441182:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+61:10565:x1875550204386816:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788664340.441323:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+61:10565:x1875550204386816:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 143us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.441331:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 123 00000100:00100000:1.0:1788664340.450821:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.451102:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204386944 00000100:00100000:0.0:1788664340.451113:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204386944 00000100:00100000:1.0:1788664340.451425:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:1.0:1788664340.451437:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+10:10565:x1875550204386944:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664340.451456:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664340.451474:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438ee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.451574:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.451583:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664340.451588:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664340.451593:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.451626:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 11 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.451640:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 11 pid: 6694 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.451654:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875550222226432:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664340.451850:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664340.456128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.456331:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204387072 00000100:00100000:2.0:1788664340.456373:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204387072 00010000:00010000:2.0:1788664340.456420:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 12 pid: 6694 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.456455:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788664340.456465:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+12:2360:x1875550204387072:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664340.456497:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664340.456524:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 12 pid: 6694 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.456537:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 12 pid: 6694 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.456562:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664340.456567:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664340.456575:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.456586:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.456621:0:7644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.456634:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7644:1875550222226560:192.168.202.14@tcp:105: 00000100:00100000:2.0:1788664340.456727:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788664340.465641:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90a02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e7 expref: 12 pid: 6694 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.465677:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875550222226432:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664340.465710:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.465728:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478200, rc 0) 00000100:00100000:2.0:1788664340.466019:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:10565:x1875550204386944:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 14583us (15205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664340.466030:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:2.0:1788664340.469699:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7644:1875550222226560:192.168.202.14@tcp:105: 00010000:00010000:2.0:1788664340.469729:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664340.469848:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+10:2360:x1875550204387072:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 13383us (13740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664340.469861:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:3.0:1788664340.474291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.474442:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204387200 00000100:00100000:2.0:1788664340.474452:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204387200 00002000:00100000:2.0:1788664340.474518:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b68c5f2a680 x1875550204387200/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:646/0 lens 504/0 e 0 to 0 dl 1788664351 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664340.474529:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c5f2a680 with x1875550204387200 ext(0->12) 00002000:00010000:2.0:1788664340.474534:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68c5f2a680 00000100:00100000:2.0:1788664340.474565:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:2.0:1788664340.474574:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+10:2360:x1875550204387200:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788664340.475244:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+12:2360:x1875550204387200:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 670us (961us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788664340.475252:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00002000:00100000:2.0:1788664340.475261:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b68c5f2a680 x1875550204387200/t4294967308(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:646/0 lens 504/448 e 0 to 0 dl 1788664351 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664340.475270:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c5f2a680 with x1875550204387200 ext(0->12) 00002000:00010000:2.0:1788664340.475273:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68c5f2a680 00000100:00100000:3.0:1788664340.478025:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.478263:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204387328 00000100:00100000:0.0:1788664340.478273:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204387328 00000100:00100000:0.0:1788664340.478338:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:0.0:1788664340.478374:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+61:10565:x1875550204387328:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788664340.517015:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788664340.517039:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788664340.517058:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c7e43480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788664340.517064:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68f882c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c7e43600 00000020:00080000:2.0:1788664340.517067:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68f882c700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c58a7400 00000004:00080000:2.0:1788664340.517090:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1788664340.517211:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222226688:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788664340.517312:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788664340.517391:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788664340.517417:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c7ebdb40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788664340.517420:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68c3ff1b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c7ebd0c0 00000020:00080000:2.0:1788664340.517423:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68c3ff1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68fb4f0000 00000020:00080000:2.0:1788664340.517445:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1788664340.517570:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222226688 00000100:00100000:3.0:1788664340.517580:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222226688 00000100:00100000:3.0:1788664340.517645:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788664340.517723:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222226688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788664340.517749:0:8476:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788664340.517792:0:8476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cda13, atime: 0x0, ctime: 0x6a9cda13, blocks: 0x1 00000100:00100000:1.0:1788664340.517799:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788664340.517801:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.517806:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222226816:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788664340.517818:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1788664340.517822:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788664340.517832:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788664340.517836:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.517854:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.517863:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222226816 00010000:00010000:3.0:1788664340.517864:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.517866:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222226816 00010000:00010000:3.0:1788664340.517872:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.517887:0:8476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664340.517890:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664340.517896:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222226816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788664340.517909:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788664340.517923:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.517938:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.517946:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788664340.517948:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664340.517952:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.517977:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.517990:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 11 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.518002:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875550222226944:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664340.518068:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eeacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664340.518126:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222227072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788664340.518153:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664340.518181:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788664340.518187:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788664340.518589:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10565:x1875550204387328:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 40217us (40573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664340.518599:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 124 00000020:00080000:2.0:1788664340.518749:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788664340.518750:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222227072 00000100:00080000:2.0:1788664340.518770:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664340.518771:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222227072 00010000:00010000:2.0:1788664340.518781:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664340.518788:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.518797:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664340.518801:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.518811:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.518827:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.518846:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000021ae140/0x762f55027be90a10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.518847:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788664340.518853:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222227072:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788664340.518864:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664340.518866:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664340.518868:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664340.518963:0:12075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788664340.518967:0:12075:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788664341 00002000:00010000:1.0:1788664340.518969:0:12075:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788664340.518971:0:12075:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788664341 -> 1788664341 00002000:00010000:1.0:1788664340.518974:0:12075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788664340.519025:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3307:x1875550222227072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (871us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788664340.519032:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:2.0:1788664340.520077:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68d1bf5c00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788664340.520086:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222227072:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788664340.520459:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875550222226688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2738us (3145us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788664340.520468:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1788664340.520687:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68c93a9c00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788664340.520693:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222226688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788664340.521165:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6697:1875550222226944:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664340.521188:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664340.521906:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.522116:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204387456 00000100:00100000:0.0:1788664340.522124:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204387456 00010000:00010000:0.0:1788664340.522179:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 12 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.522259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:0.0:1788664340.522269:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+12:2361:x1875550204387456:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664340.522284:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664340.522291:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 12 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.522304:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 12 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.522327:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077637a60/0x762f55027be907d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24384d expref: 12 pid: 6697 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.522382:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664340.522387:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664340.522393:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.522404:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.522437:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664340.522487:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+11:2361:x1875550204387456:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 218us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.522504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00010000:00010000:3.0:1788664340.522562:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.522572:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.522583:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.522590:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.522614:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664340.523163:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.523260:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204387584 00000100:00100000:1.0:1788664340.523266:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204387584 00000100:00100000:1.0:1788664340.523300:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788664340.523309:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:2360:x1875550204387584:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788664340.525491:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664340.525505:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.525517:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664340.525522:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.525533:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.525553:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.525562:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c006b5f2/0x762f55027be90a17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.525586:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664340.525588:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664340.525590:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664340.526505:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1875550222226816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8603us (8665us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788664340.526516:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1788664340.526583:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68c93aa300/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788664340.526590:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222226816:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788664340.546967:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788664340.546986:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788664340.546993:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788664340.547002:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204387584:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 23689us (23835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.547014:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788664340.549810:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664340.549896:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204387840 00000100:00100000:3.0:1788664340.549905:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204387840 00000100:00100000:3.0:1788664340.550011:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:3.0:1788664340.550022:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10565:x1875550204387840:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664340.550091:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664340.550117:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be909fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438e0 expref: 15 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.550135:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:3.0:1788664340.550141:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664340.550174:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.550186:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.550196:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664340.550525:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc55127c reply state 00000000011cc4cf transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664340.550532:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664340.550629:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+16:10565:x1875550204387840:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 608us (829us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788664340.550637:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 125 00000100:00100000:1.0:1788664340.552722:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:0.0:1788664340.552906:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.552915:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.552921:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.552925:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664340.552933:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.552939:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.552951:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:0.0:1788664340.552953:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664340.552957:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.552961:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.553211:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204387968 00000100:00100000:2.0:1788664340.553220:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204387968 00000100:00100000:2.0:1788664340.553273:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788664340.553285:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204387968:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788664340.553488:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788664340.553491:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788664341 -> 1788664340 00002000:00010000:2.0:1788664340.553494:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788664339 00002000:00010000:2.0:1788664340.553496:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788664341 -> 1788664340 00002000:00010000:2.0:1788664340.553498:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788664340.553561:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204387968:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 278us (848us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788664340.553569:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:1.0:1788664340.557569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.557662:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204388224 00000100:00100000:2.0:1788664340.557672:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204388224 00000100:00100000:2.0:1788664340.557780:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:2.0:1788664340.557790:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+15:10565:x1875550204388224:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788664340.558063:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.558078:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 15 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.558084:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.558115:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 15 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.558128:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 15 pid: 7653 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.558142:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222227200:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664340.558248:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c93319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664340.560822:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222227200:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664340.560850:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.561133:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.561837:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204388352 00000100:00100000:0.0:1788664340.561845:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204388352 00010000:00010000:1.0:1788664340.562021:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 16 pid: 7653 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.562053:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:1.0:1788664340.562062:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+16:2360:x1875550204388352:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664340.562078:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664340.562085:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 16 pid: 7653 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.562097:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 16 pid: 7653 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.562165:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be909df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d2 expref: 16 pid: 7653 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.562225:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:1.0:1788664340.562230:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.562237:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.562244:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.562273:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664340.562299:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.562307:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.562366:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.562374:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.562381:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.562388:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664340.562393:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.562402:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.562412:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:2.0:1788664340.562415:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788664340.562418:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.562422:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+15:2360:x1875550204388352:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 361us (1288us total) trans 0 rc 0/0 00010000:00010000:2.0:1788664340.562425:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90a25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.562430:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:2.0:1788664340.562481:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10565:x1875550204388224:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 4680us (4909us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788664340.562489:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 126 00000100:00100000:1.0:1788664340.564255:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.564302:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204388480 00000100:00100000:2.0:1788664340.564309:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204388480 00000100:00100000:2.0:1788664340.564371:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:2.0:1788664340.564393:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204388480:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788664340.564439:0:12075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.564458:0:12075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.564576:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664340.564581:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664340.564587:0:12075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.564625:0:12075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.564640:0:12075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 7 pid: 6696 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.564655:0:12075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12075:1875550222227328:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664340.564732:0:12075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c93319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664340.566085:0:12075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12075:1875550222227328:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664340.566124:0:12075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.567529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.568109:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204388608 00000100:00100000:2.0:1788664340.568131:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204388608 00010000:00010000:2.0:1788664340.568168:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 8 pid: 6696 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.568209:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:2.0:1788664340.568219:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204388608:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664340.568233:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664340.568258:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 8 pid: 6696 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.568271:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 8 pid: 6696 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.568294:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8100150/0x762f55027be90a09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438ee expref: 8 pid: 6696 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.568311:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664340.568315:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664340.568321:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.568331:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.568383:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664340.568430:0:12075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.568430:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204388608:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 213us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664340.568446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00010000:00010000:3.0:1788664340.568449:0:12075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.568478:0:12075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.568487:0:12075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.568495:0:12075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.568503:0:12075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664340.568507:0:12075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.568517:0:12075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.568530:0:12075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.568538:0:12075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be90a2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664340.568583:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2360:x1875550204388480:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 4194us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664340.568589:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:1.0:1788664340.570153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.570225:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204388864 00000100:00100000:0.0:1788664340.570234:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204388864 00000100:00100000:0.0:1788664340.570285:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 127 00000100:00100000:0.0:1788664340.570294:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10565:x1875550204388864:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788664340.570403:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.570419:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.570428:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.570634:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.570646:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.570656:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.570689:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.570703:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 15 pid: 5855 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.570717:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222227456:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664340.570809:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e430c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664340.575243:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222227456:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664340.575268:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664340.576612:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664340.577837:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204388992 00000100:00100000:2.0:1788664340.577848:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204388992 00010000:00010000:2.0:1788664340.577893:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 16 pid: 5855 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.578049:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:2.0:1788664340.578059:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+16:2361:x1875550204388992:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664340.578076:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664340.578083:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 16 pid: 5855 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.578109:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 16 pid: 5855 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.578132:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be909ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438d9 expref: 16 pid: 5855 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.578148:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:2.0:1788664340.578154:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.578163:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.578172:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.578286:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664340.578502:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+15:2361:x1875550204388992:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 444us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664340.578511:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00010000:00010000:0.0:1788664340.579719:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.579733:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664340.580068:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788664340.580216:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788664340.580262:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788664340.580583:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5856:1875550222227584:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788664340.580722:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664340.580821:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7e43840 going to sleep for 11 seconds 00000100:00100000:3.0:1788664340.580869:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222227584 00000100:00100000:3.0:1788664340.580877:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222227584 00000100:00100000:3.0:1788664340.581100:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664340.581111:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1875550222227584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788664340.581197:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1875550222227584:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664340.581205:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664340.581265:0:5856:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788664340.581271:0:5856:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788664340.581289:0:5856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68d1bf5c00, transno 4294967309 00000100:00100000:0.0:1788664340.581314:0:5856:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9b68c93aa300 x1875550222226816/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788664356 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664340.581327:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5856:1875550222227584:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788664340.581839:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788664340.581911:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5856:1875550222227712:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788664340.581963:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664340.582593:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664340.582623:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222227712 00000100:00100000:1.0:1788664340.582630:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222227712 00000100:00100000:1.0:1788664340.582722:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664340.582730:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1875550222227712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788664340.583113:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5856:x1875550222227712:12345-0@lo:1000:mdt00_002.0 Request processed in 382us (1148us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788664340.583122:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664340.583184:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5856:1875550222227712:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788664340.583222:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583240:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583248:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583255:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664340.583260:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583269:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583285:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969000) 00010000:00010000:0.0:1788664340.583288:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664340.583293:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583300:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90a3a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583333:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583460:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583469:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583474:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664340.583484:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583490:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583499:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:0.0:1788664340.583501:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664340.583508:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583521:0:5856:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583531:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.583560:0:5856:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.583572:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222227840:192.168.202.14@tcp:105: 00000100:00100000:0.0:1788664340.583743:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664340.586493:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222227840:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788664340.586526:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586536:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9097d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586588:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586602:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586614:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586627:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586633:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586651:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586656:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664340.586661:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586668:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586679:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:0.0:1788664340.586682:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664340.586685:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586691:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586709:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586714:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586720:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586725:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664340.586728:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586734:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586743:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:0.0:1788664340.586755:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788664340.586759:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.586765:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90a33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.587162:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+18:10565:x1875550204388864:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 16867us (17014us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788664340.587173:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 127 00000020:00080000:0.0:1788664340.587178:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788664340.587337:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664340.587383:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664340.587893:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788664340.588071:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788664340.589821:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.589886:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204389120 00000100:00100000:0.0:1788664340.589895:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204389120 00000100:00100000:0.0:1788664340.589970:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:0.0:1788664340.589980:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+18:10564:x1875550204389120:12345-192.168.202.14@tcp:49:lfs.0 00000100:00100000:0.0:1788664340.590112:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+18:10564:x1875550204389120:12345-192.168.202.14@tcp:49:lfs.0 Request processed in 133us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.590119:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:1.0:1788664340.606521:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.606557:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.606761:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204389376 00000100:00100000:0.0:1788664340.606771:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204389376 00000100:00100000:0.0:1788664340.606817:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:0.0:1788664340.606825:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7ebb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+18:10565:x1875550204389376:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788664340.607092:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204389632 00000100:00100000:2.0:1788664340.607096:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204389632 00000100:00100000:2.0:1788664340.607176:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 128 00000100:00100000:2.0:1788664340.607182:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+19:10564:x1875550204389632:12345-192.168.202.14@tcp:58:lfs.0 00000040:00080000:2.0:1788664340.607541:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788664340.607619:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+19:10564:x1875550204389632:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 436us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664340.607627:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 128 00000004:00080000:1.0:1788664340.610255:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788664340.610403:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788664340.610468:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.610485:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.610499:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.610515:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.610522:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.610528:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.610545:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664340.610660:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7ebb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:10565:x1875550204389376:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 3831us (4146us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788664340.610670:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000020:00080000:1.0:1788664340.610675:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788664340.610806:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664340.610814:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.610821:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664340.610825:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.610834:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.610847:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b68dc969e00) 00010000:00010000:2.0:1788664340.610855:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664340.610860:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.610865:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90a48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664340.610881:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664340.610882:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664340.610883:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664340.629231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664340.629548:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204389760 00000100:00100000:3.0:1788664340.629559:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204389760 00000100:00100000:3.0:1788664340.629628:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 129 00000100:00100000:3.0:1788664340.629639:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:10567:x1875550204389760:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664340.629667:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664340.629688:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90a4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438f5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.629797:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.629810:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.629819:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.629845:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.629850:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.629854:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.630222:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.630231:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.630238:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.630276:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664340.630291:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 21 pid: 5856 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664340.630303:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222227968:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664340.631148:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788664340.633018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.633076:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f28380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222227968:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664340.633099:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664340.633241:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204390016 00000100:00100000:2.0:1788664340.633249:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204390016 00000100:00100000:2.0:1788664340.633298:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:2.0:1788664340.633305:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+22:5599:x1875550204390016:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788664340.633570:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+23:5599:x1875550204390016:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 264us (561us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788664340.633579:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:1.0:1788664340.635015:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664340.635080:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204390144 00000100:00100000:0.0:1788664340.635089:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204390144 00010000:00010000:0.0:1788664340.635124:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 23 pid: 5856 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.635158:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:0.0:1788664340.635168:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+23:2360:x1875550204390144:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664340.635182:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664340.635188:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 23 pid: 5856 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.635200:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 23 pid: 5856 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.635221:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be9096f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438b6 expref: 23 pid: 5856 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.635233:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:0.0:1788664340.635250:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.635259:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.635264:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664340.635287:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664340.635307:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635315:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664340.635371:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+22:2360:x1875550204390144:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 173us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.635379:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00000004:00200000:1.0:1788664340.635773:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788664340.635779:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664340.635804:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635827:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635838:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635845:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635852:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635857:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664340.635861:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635866:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635874:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:1.0:1788664340.635876:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664340.635879:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.635882:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90a56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636207:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636212:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636222:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636226:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664340.636227:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636231:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636236:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b68c3811a00) 00010000:00010000:1.0:1788664340.636238:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664340.636240:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636243:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90a5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636277:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438f5 expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636285:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438f5 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664340.636290:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664340.636292:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664340.636293:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147ac00, rc 0) 00000100:00100000:1.0:1788664340.636396:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10567:x1875550204389760:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 6759us (7172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664340.636409:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 129 00000100:00100000:1.0:1788664340.927398:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.927426:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.927457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.927492:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664340.927540:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204390400 00000100:00100000:1.0:1788664340.927550:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204390400 00000100:00100000:1.0:1788664340.927602:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204390528 00000100:00100000:1.0:1788664340.927606:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204390528 00000100:00100000:1.0:1788664340.927645:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:1.0:1788664340.927656:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204390400:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664340.927748:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204390400:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 94us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664340.927757:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:1.0:1788664340.927776:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:1.0:1788664340.927783:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204390528:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664340.927812:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204390528:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664340.927818:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:1.0:1788664340.927839:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204390656 00000100:00100000:1.0:1788664340.927843:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204390656 00000100:00100000:1.0:1788664340.927898:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00100000:1.0:1788664340.927907:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204390656:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664340.927934:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204390656:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664340.927948:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00080000:1.0:1788664340.927967:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664340.927972:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664340.928546:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204390272 00000100:00100000:0.0:1788664340.928554:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204390272 00000100:00100000:0.0:1788664340.928689:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 290 00000100:00100000:0.0:1788664340.928713:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204390272:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664340.928760:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204390272:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 63us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664340.928767:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 290 00000040:00080000:2.0:1788664341.216136:0:12113:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664341.216148:0:12113:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664341.216201:0:12113:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788664341.216207:0:12113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788664341.282876:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664341.599904:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664341.599915:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664341.599966:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788664341.599973:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664341.600110:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222228096:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664341.600235:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c93319c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664341.621303:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88afb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222228096:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664341.630926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664341.631055:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204390784 00000100:00100000:0.0:1788664341.631065:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204390784 00000100:00100000:0.0:1788664341.631121:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00100000:0.0:1788664341.631129:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10579:x1875550204390784:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788664341.631171:0:5856:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788664341.631282:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10579:x1875550204390784:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 154us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664341.631301:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 130 00000100:00100000:3.0:1788664341.653676:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664341.654552:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204391040 00000100:00100000:1.0:1788664341.654564:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204391040 00000100:00100000:1.0:1788664341.654640:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 131 00000100:00100000:1.0:1788664341.654652:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+21:10579:x1875550204391040:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664341.654675:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664341.654696:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90a6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2438fc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664341.654818:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90a72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664341.654833:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664341.654845:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664341.654857:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788664341.654984:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90a6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438fc expref: 24 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664341.655004:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90a72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438fc expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664341.655013:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664341.655029:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664341.655048:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3c00, rc 0) 00000100:00100000:1.0:1788664341.655116:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+23:10579:x1875550204391040:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 466us (1451us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788664341.655123:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 131 00000100:00100000:2.0:1788664341.660278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664341.660319:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204391168 00000100:00100000:1.0:1788664341.660377:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204391168 00000100:00100000:1.0:1788664341.660442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788664341.660452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+23:2360:x1875550204391168:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664341.660468:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664341.660493:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90a72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438fc expref: 23 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664341.660511:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664341.660516:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664341.660572:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5891c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+22:2360:x1875550204391168:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 122us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664341.660580:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:2.0:1788664341.677801:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664341.677947:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204391424 00000100:00100000:0.0:1788664341.677958:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204391424 00000100:00100000:0.0:1788664341.678022:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 132 00000100:00100000:0.0:1788664341.678043:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+22:10579:x1875550204391424:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788664341.678138:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678156:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678170:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678402:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678412:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678419:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678424:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664341.678428:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678436:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678464:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:0.0:1788664341.678467:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788664341.678485:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664341.678667:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90a80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664341.678818:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+23:10579:x1875550204391424:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 786us (1027us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788664341.678827:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 132 00000040:00080000:2.0:1788664341.680146:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664341.680152:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664341.680678:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788664341.680686:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664341.683496:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664341.683894:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204391680 00000100:00100000:2.0:1788664341.683903:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204391680 00000100:00100000:2.0:1788664341.684011:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:2.0:1788664341.684021:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+23:10579:x1875550204391680:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788664341.684254:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+24:10579:x1875550204391680:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 234us (766us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788664341.684262:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00010000:00010000:3.0:1788664342.307336:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664342.822980:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222228224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664342.823068:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664342.825332:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222228224 00000100:00100000:3.0:1788664342.825371:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222228224 00000100:00100000:3.0:1788664342.825455:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664342.825475:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875550222228224:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664342.825498:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788664342.825536:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664342.825621:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875550222228224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664342.825629:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664342.826233:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222228224:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788664343.313206:0:12164:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664343.313214:0:12164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664343.313255:0:12164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788664343.313260:0:12164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788664343.327508:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664343.518091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664343.519490:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204391936 00000100:00100000:1.0:1788664343.519505:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204391936 00000100:00100000:1.0:1788664343.519581:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00100000:1.0:1788664343.519592:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+24:10600:x1875550204391936:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664343.519619:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664343.519644:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243903 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788664343.519857:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788664343.522936:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2c00/0x762f55027be90a8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664343.522970:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2c00/0x762f55027be90a8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664343.522983:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2c00/0x762f55027be90a8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664343.523006:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788664343.523175:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243903 expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664343.523193:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2c00/0x762f55027be90a8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243903 expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664343.523202:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:1.0:1788664343.523206:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788664343.523210:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2c00, rc 0) 00000100:00100000:1.0:1788664343.523296:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+26:10600:x1875550204391936:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 3705us (5214us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788664343.523306:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 133 00000100:00100000:0.0:1788664343.544123:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664343.545072:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392064 00000100:00100000:3.0:1788664343.545084:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392064 00000100:00100000:3.0:1788664343.545149:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 134 00000100:00100000:3.0:1788664343.545162:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+26:10600:x1875550204392064:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:3.0:1788664343.545239:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545257:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545269:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545298:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545305:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545330:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545367:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664343.545372:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545380:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545392:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:3.0:1788664343.545396:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664343.545401:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.545407:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90a9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664343.545481:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+26:10600:x1875550204392064:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 322us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664343.545489:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 134 00000100:00100000:1.0:1788664343.640723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664343.640824:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392192 00000100:00100000:3.0:1788664343.640838:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392192 00000100:00080000:2.0:1788664343.640932:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664343.640971:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:3.0:1788664343.640985:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204392192:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:3.0:1788664343.641010:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664343.641037:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000021ae140/0x762f55027be90aa3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24390a expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664343.641094:0:12075:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cda14, atime: 0x6a9cda13, ctime: 0x6a9cda14, blocks: 0xb 00010000:00010000:3.0:1788664343.641121:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1788664343.641126:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664343.641137:0:12075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000021ae140/0x762f55027be90aa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24390a expref: 7 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.641158:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000021ae140/0x762f55027be90aa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24390a expref: 7 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664343.641172:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a400, rc 0) 00000100:00100000:3.0:1788664343.641249:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204392192:12345-192.168.202.14@tcp:101:cat.0 Request processed in 267us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664343.641256:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:3.0:1788664343.646920:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664343.647153:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392320 00000100:00100000:1.0:1788664343.647164:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392320 00002000:00100000:1.0:1788664343.647213:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b68c12a9500 x1875550204392320/t0(0) o3->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:649/0 lens 488/0 e 0 to 0 dl 1788664354 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664343.647222:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c12a9500 with x1875550204392320 ext(0->4095) 00002000:00010000:1.0:1788664343.647228:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68c12a9500 00000100:00100000:1.0:1788664343.647264:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:1.0:1788664343.647284:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204392320:12345-192.168.202.14@tcp:3:cat.0 00000100:00100000:1.0:1788664343.647521:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204392320:12345-192.168.202.14@tcp:3:cat.0 Request processed in 236us (610us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788664343.647527:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00002000:00100000:1.0:1788664343.647532:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9b68c12a9500 x1875550204392320/t0(0) o3->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:649/0 lens 488/4536 e 0 to 0 dl 1788664354 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664343.647537:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c12a9500 with x1875550204392320 ext(0->4095) 00002000:00010000:1.0:1788664343.647540:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68c12a9500 00000001:00080000:0.0:1788664343.935332:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788664343.935535:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788664343.935544:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788664344.351604:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222228608:0@lo:400:kworker.0 00000100:00100000:0.0:1788664344.351684:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664344.351745:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664344.351751:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222228736:0@lo:400:kworker.0 00000100:00100000:0.0:1788664344.351778:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664344.351856:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222228352:0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.351890:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664344.351929:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222228864:0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.351950:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664344.351968:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788664344.351973:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222228480:0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.351993:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664344.352009:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222228992:0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.352053:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664344.352102:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222228352 00000100:00100000:3.0:1788664344.352110:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222228352 00000100:00100000:3.0:1788664344.352156:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788664344.352166:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222228352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.352235:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222228352:12345-0@lo:400:kworker.0 Request processed in 59us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664344.352242:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788664344.352276:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222228608 00000100:00100000:3.0:1788664344.352279:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222228608 00000100:00100000:3.0:1788664344.352311:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222228864 00000100:00100000:3.0:1788664344.352314:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222228864 00000100:00100000:3.0:1788664344.352326:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222228480 00000100:00100000:3.0:1788664344.352329:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222228480 00000100:00100000:3.0:1788664344.352373:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788664344.352381:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222228608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.352422:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222228608:12345-0@lo:400:kworker.0 Request processed in 43us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664344.352429:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788664344.352441:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788664344.352447:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222228864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.352474:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222228864:12345-0@lo:400:kworker.0 Request processed in 27us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664344.352478:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788664344.352489:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788664344.352494:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222228480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.352518:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222228480:12345-0@lo:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664344.352532:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788664344.352559:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222228736 00000100:00100000:3.0:1788664344.353280:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222228736 00000100:00100000:3.0:1788664344.353499:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222228992 00000100:00100000:3.0:1788664344.353505:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222228992 00000100:00100000:3.0:1788664344.353529:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788664344.353537:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222228736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.353595:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222228736:12345-0@lo:400:kworker.0 Request processed in 59us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664344.353602:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788664344.353614:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788664344.353620:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222228992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.353652:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222228992:12345-0@lo:400:kworker.0 Request processed in 33us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664344.353659:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788664344.353685:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788664344.353689:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664344.353692:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664344.353733:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222228480:0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.353743:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788664344.353749:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788664344.353768:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68c93a9c00, transno 4294967304 00000100:00100000:3.0:1788664344.353776:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222228992:0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.353786:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222228352:0@lo:400:kworker.0 00000100:00100000:3.0:1788664344.353794:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222228864:0@lo:400:kworker.0 00010000:00010000:0.0:1788664344.377194:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664344.377271:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222228736:0@lo:400:kworker.0 00000100:00100000:0.0:1788664344.377289:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222228608:0@lo:400:kworker.0 00000100:00100000:0.0:1788664344.866701:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664344.866724:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222229120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664344.866795:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664344.866870:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222229120 00000100:00100000:0.0:1788664344.866878:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222229120 00000100:00100000:0.0:1788664344.866923:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664344.866931:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222229120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664344.866966:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664344.867012:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222229120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664344.867019:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664344.867259:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222229120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788664345.376245:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664346.041777:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664346.041824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664346.041878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664346.041914:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664346.041948:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664346.041979:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392832 00000100:00100000:0.0:1788664346.042006:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392832 00000100:00100000:0.0:1788664346.042067:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392704 00000100:00100000:0.0:1788664346.042071:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392704 00000100:00100000:0.0:1788664346.042094:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:0.0:1788664346.042103:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204392832:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664346.042178:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204392832:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 77us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664346.042186:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:0.0:1788664346.042205:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:0.0:1788664346.042211:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204392704:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664346.042253:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204392704:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 42us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664346.042259:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:0.0:1788664346.042289:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392576 00000100:00100000:0.0:1788664346.042293:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392576 00000100:00100000:0.0:1788664346.042328:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392960 00000100:00100000:0.0:1788664346.042331:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392960 00000100:00100000:0.0:1788664346.042387:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:0.0:1788664346.042395:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+26:2359:x1875550204392576:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664346.042597:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+26:2359:x1875550204392576:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 202us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664346.042605:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:0.0:1788664346.042620:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00100000:0.0:1788664346.042627:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204392960:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664346.042655:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204392960:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664346.042661:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00080000:0.0:1788664346.042678:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664346.042683:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788664346.042685:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664346.043683:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204392448 00000100:00100000:0.0:1788664346.043693:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204392448 00000100:00100000:0.0:1788664346.043746:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 292 00000100:00100000:0.0:1788664346.043756:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204392448:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664346.043806:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204392448:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 52us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664346.043830:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 292 00000001:00080000:2.0:1788664346.045625:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1788664346.045639:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788664346.053896:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1788664346.053926:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c7e43840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788664346.053932:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68f882c500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c7e43f00 00000020:00080000:2.0:1788664346.053935:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68f882cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c824d800 00000001:00080000:2.0:1788664346.053971:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788664346.054001:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788664346.054436:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788664346.054679:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788664346.400036:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664347.424277:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664347.935593:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222229248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664347.935680:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664347.935855:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222229248 00000100:00100000:1.0:1788664347.935865:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222229248 00000100:00100000:1.0:1788664347.935937:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788664347.935947:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222229248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664347.935981:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788664347.936040:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664347.938005:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222229248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2053us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664347.938018:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788664347.938332:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788664347.938350:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68c93aa300, transno 4294967310 00000004:00080000:0.0:1788664347.938365:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788664347.938396:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222229248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664348.459013:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664348.831618:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664348.831628:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664348.832117:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788664348.832124:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788664349.471799:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788664349.471875:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664349.471900:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222229504:0@lo:400:kworker.0 00000100:00100000:3.0:1788664349.471975:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788664349.472169:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664349.472184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222229504 00000100:00100000:0.0:1788664349.472192:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222229504 00000100:00100000:0.0:1788664349.472243:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788664349.472252:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222229504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664349.472306:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222229504:12345-0@lo:400:kworker.0 Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664349.472314:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788664349.472380:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222229504:0@lo:400:kworker.0 00000100:00100000:1.0:1788664349.477186:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222229376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664349.477270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664349.477503:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222229376 00000100:00100000:3.0:1788664349.477521:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222229376 00000100:00100000:3.0:1788664349.477572:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788664349.477581:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222229376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664349.477638:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222229376:12345-0@lo:400:kworker.0 Request processed in 58us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664349.477645:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788664349.478002:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222229376:0@lo:400:kworker.0 00000100:00100000:3.0:1788664349.481539:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222229888:0@lo:400:kworker.0 00000100:00100000:3.0:1788664349.481601:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664349.481781:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222229760:0@lo:400:kworker.0 00000100:00100000:0.0:1788664349.481815:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664349.481838:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664349.481844:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222229632:0@lo:400:kworker.0 00000100:00100000:0.0:1788664349.481867:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664349.481895:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222229760 00000100:00100000:0.0:1788664349.481915:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222229760 00000100:00100000:0.0:1788664349.481968:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788664349.481977:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222229760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664349.482028:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222229760:12345-0@lo:400:kworker.0 Request processed in 51us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664349.482048:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788664349.482068:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664349.482097:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222229760:0@lo:400:kworker.0 00000100:00100000:2.0:1788664349.482256:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222229888 00000100:00100000:2.0:1788664349.482261:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222229888 00000100:00100000:2.0:1788664349.482297:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222229632 00000100:00100000:2.0:1788664349.482300:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222229632 00000100:00100000:2.0:1788664349.482329:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788664349.482336:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222229888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664349.482393:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222229888:12345-0@lo:400:kworker.0 Request processed in 57us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664349.482399:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788664349.482413:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788664349.482419:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222229632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664349.482448:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222229632:12345-0@lo:400:kworker.0 Request processed in 30us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664349.482454:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788664349.482777:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664349.482799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222229632:0@lo:400:kworker.0 00000100:00100000:3.0:1788664349.482854:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664349.482865:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222230016:0@lo:400:kworker.0 00000100:00100000:3.0:1788664349.482894:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664349.482926:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222229888:0@lo:400:kworker.0 00000100:00100000:0.0:1788664349.482985:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230016 00000100:00100000:0.0:1788664349.482990:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230016 00000100:00100000:0.0:1788664349.483041:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788664349.483048:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222230016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664349.483085:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222230016:12345-0@lo:400:kworker.0 Request processed in 38us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664349.483092:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788664349.483256:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222230016:0@lo:400:kworker.0 00000100:00080000:2.0:1788664349.485415:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664349.507278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664349.507445:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204393088 00000100:00100000:2.0:1788664349.507455:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204393088 00000100:00100000:2.0:1788664349.507555:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 135 00000100:00100000:2.0:1788664349.507566:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10244:x1875550204393088:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788664349.507790:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664349.507967:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10244:x1875550204393088:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 Request processed in 401us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664349.507987:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 135 00000100:00100000:0.0:1788664349.516524:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664349.517067:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204393344 00000100:00100000:2.0:1788664349.517079:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204393344 00000100:00100000:2.0:1788664349.517139:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788664349.517148:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:10244:x1875550204393344:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788664349.517515:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+14:10244:x1875550204393344:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 359us (1002us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788664349.517524:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:1.0:1788664349.983763:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664349.983787:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222230144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664349.983862:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664349.983993:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230144 00000100:00100000:0.0:1788664349.984003:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230144 00000100:00100000:0.0:1788664349.984049:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664349.984058:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222230144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664349.984091:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664349.984135:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222230144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664349.984141:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664349.984197:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222230144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664350.030819:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664350.030930:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204393472 00000100:00100000:2.0:1788664350.030939:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204393472 00000100:00100000:2.0:1788664350.031019:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 136 00000100:00100000:2.0:1788664350.031030:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+5:11053:x1875550204393472:12345-192.168.202.14@tcp:101:lsof.0 00010000:00010000:2.0:1788664350.031050:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664350.031071:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90aaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243911 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664350.031141:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664350.031155:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664350.031168:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664350.031227:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788664350.031232:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664350.031271:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664350.031296:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664350.031315:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664350.031488:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:2.0:1788664350.031492:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664350.031496:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb600, rc 0) 00000100:00100000:2.0:1788664350.031552:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+6:11053:x1875550204393472:12345-192.168.202.14@tcp:101:lsof.0 Request processed in 524us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664350.031560:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 136 00000100:00080000:3.0:1788664350.031769:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788664350.497499:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788664351.156220:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788664351.156253:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788664351.156322:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788664351.156333:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788664351.157756:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664351.157837:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204393600 00000100:00100000:3.0:1788664351.157847:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204393600 00000100:00100000:3.0:1788664351.157913:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 294 00000100:00100000:3.0:1788664351.157924:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2360:x1875550204393600:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664351.158014:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2360:x1875550204393600:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664351.158022:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 294 00000100:00100000:2.0:1788664351.159140:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664351.159256:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204393728 00000100:00100000:1.0:1788664351.159262:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204393728 00000100:00100000:1.0:1788664351.159336:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00100000:1.0:1788664351.159363:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2360:x1875550204393728:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664351.159418:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2360:x1875550204393728:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664351.159426:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00080000:3.0:1788664351.159707:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664351.160109:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664351.160137:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664351.160167:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664351.160230:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204393984 00000100:00100000:0.0:1788664351.160235:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204393984 00000100:00100000:0.0:1788664351.160297:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204393856 00000100:00100000:0.0:1788664351.160301:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204393856 00000100:00100000:0.0:1788664351.160325:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:0.0:1788664351.160333:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204393984:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664351.160386:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204393984:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 54us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664351.160392:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:0.0:1788664351.160406:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:0.0:1788664351.160413:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204393856:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664351.160445:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204393856:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664351.160451:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:2.0:1788664351.160884:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204394112 00000100:00100000:2.0:1788664351.160889:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204394112 00000100:00100000:2.0:1788664351.160924:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 152 00000100:00100000:2.0:1788664351.160933:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2361:x1875550204394112:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664351.160966:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2361:x1875550204394112:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664351.160982:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 152 00000100:00080000:1.0:1788664351.161107:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664351.161110:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788664351.519568:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664352.543506:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664353.058488:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664353.058514:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222230272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664353.058608:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664353.058750:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230272 00000100:00100000:1.0:1788664353.058758:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230272 00000100:00100000:1.0:1788664353.058828:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664353.058838:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68df914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222230272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664353.058889:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664353.058943:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68df914c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222230272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664353.058950:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664353.059200:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222230272:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664353.059483:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664353.567631:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664354.598559:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222230528:0@lo:400:kworker.0 00000100:00100000:2.0:1788664354.598623:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664354.598672:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222231040:0@lo:400:kworker.0 00000100:00100000:2.0:1788664354.598699:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664354.598728:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664354.598734:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222230400:0@lo:400:kworker.0 00000100:00100000:2.0:1788664354.598760:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664354.598778:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222230912:0@lo:400:kworker.0 00000100:00100000:2.0:1788664354.598797:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664354.598835:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222230656:0@lo:400:kworker.0 00000100:00100000:2.0:1788664354.598858:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664354.598874:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664354.598879:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222230784:0@lo:400:kworker.0 00000100:00100000:2.0:1788664354.598900:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664354.598925:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664354.598939:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230528 00000100:00100000:2.0:1788664354.598947:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230528 00000100:00100000:2.0:1788664354.598996:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230912 00000100:00100000:2.0:1788664354.598999:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230912 00000100:00100000:2.0:1788664354.599018:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230656 00000100:00100000:2.0:1788664354.599021:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230656 00000100:00100000:0.0:1788664354.599053:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230400 00000100:00100000:2.0:1788664354.599057:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788664354.599057:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230400 00000100:00100000:2.0:1788664354.599065:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222230528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.599086:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788664354.599092:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222230400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664354.599169:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231040 00000100:00100000:3.0:1788664354.599179:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231040 00000100:00100000:3.0:1788664354.599208:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222230784 00000100:00100000:3.0:1788664354.599211:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222230784 00000100:00100000:3.0:1788664354.599229:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788664354.599235:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222231040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.603330:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222230400:12345-0@lo:400:kworker.0 Request processed in 4228us (4559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664354.603377:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788664354.603454:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788664354.603468:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222230784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.603543:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222230784:12345-0@lo:400:kworker.0 Request processed in 81us (4641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664354.603549:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788664354.603580:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788664354.603589:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222230912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.603623:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222230912:12345-0@lo:400:kworker.0 Request processed in 36us (4824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664354.603630:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788664354.603658:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788664354.603665:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222230656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.603694:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222230656:12345-0@lo:400:kworker.0 Request processed in 30us (4835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664354.603701:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788664354.603764:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222230784:0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.604131:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222230656:0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.604180:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222230400:0@lo:400:kworker.0 00000100:00100000:0.0:1788664354.604192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222230912:0@lo:400:kworker.0 00000100:00100000:2.0:1788664354.604451:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222230528:12345-0@lo:400:kworker.0 Request processed in 5384us (5825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664354.604458:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1788664354.604502:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664354.604508:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664354.608269:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222230528:0@lo:400:kworker.0 00000100:00100000:3.0:1788664354.609004:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222231040:12345-0@lo:400:kworker.0 Request processed in 9765us (10300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664354.609026:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788664354.609758:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222231040:0@lo:400:kworker.0 00000100:00100000:1.0:1788664355.104233:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222231168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664355.104310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664355.104564:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231168 00000100:00100000:0.0:1788664355.104583:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231168 00000100:00100000:0.0:1788664355.104650:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664355.104661:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222231168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664355.104699:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664355.104761:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222231168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664355.104767:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664355.104818:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222231168:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788664355.506266:0:12367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:12:33 (1788664353) 00010000:00010000:2.0:1788664355.615935:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664356.289431:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664356.289464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664356.289498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664356.289534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664356.289557:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664356.289563:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204394240 00000100:00100000:2.0:1788664356.289583:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204394240 00000100:00100000:2.0:1788664356.289645:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 296 00000100:00100000:2.0:1788664356.289655:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204394240:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664356.289670:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204394368 00000100:00100000:0.0:1788664356.289675:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204394368 00000100:00100000:0.0:1788664356.289715:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204394752 00000100:00100000:2.0:1788664356.289726:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204394240:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664356.289731:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204394752 00000100:00100000:2.0:1788664356.289733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 296 00000100:00100000:0.0:1788664356.289754:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 156 00000100:00100000:0.0:1788664356.289760:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2358:x1875550204394368:12345-192.168.202.14@tcp:400:kworker.0 00000100:00080000:2.0:1788664356.289780:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664356.289793:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 157 00000100:00100000:2.0:1788664356.289800:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2358:x1875550204394752:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664356.289824:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2358:x1875550204394368:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 63us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664356.289835:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 156 00000100:00100000:3.0:1788664356.290089:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204394624 00000100:00100000:3.0:1788664356.290094:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204394624 00000100:00100000:3.0:1788664356.290140:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204394496 00000100:00100000:3.0:1788664356.290143:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204394496 00000100:00100000:3.0:1788664356.290163:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:3.0:1788664356.290170:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204394624:12345-192.168.202.14@tcp:400:kworker.0 00000100:00080000:1.0:1788664356.290231:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664356.290235:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664356.290256:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:1.0:1788664356.290264:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204394496:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664356.297743:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2358:x1875550204394752:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 7926us (8167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664356.297760:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 157 00000100:00100000:3.0:1788664356.304415:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2358:x1875550204394624:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 14220us (14924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664356.304438:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:1.0:1788664356.319371:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204394496:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29073us (29801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664356.319391:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00010000:00010000:0.0:1788664356.642312:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664357.665466:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664358.049790:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664358.049832:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664358.050246:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788664358.050255:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664358.176023:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222231296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664358.176102:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664358.176253:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231296 00000100:00100000:2.0:1788664358.176261:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231296 00000100:00100000:2.0:1788664358.176370:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664358.176381:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222231296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664358.176437:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664358.176496:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222231296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664358.176503:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788664358.176552:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222231296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788664358.177300:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664358.315549:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664358.315668:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395008 00000100:00100000:2.0:1788664358.315679:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395008 00000100:00100000:2.0:1788664358.315752:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00100000:2.0:1788664358.315764:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:11318:x1875550204395008:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664358.315794:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664358.315816:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ab8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243918 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.315911:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.315935:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.315949:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.315963:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.315971:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.315977:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316433:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90acd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316444:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316451:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664358.316462:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788664358.316612:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316620:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316627:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316632:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664358.316637:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316643:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316656:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b68e9aff700) 00010000:00010000:2.0:1788664358.316659:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664358.316664:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316680:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90abf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316695:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316701:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316706:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316712:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664358.316714:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316721:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316729:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b68e9aff200) 00010000:00010000:2.0:1788664358.316731:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664358.316733:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.316739:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90ac6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.317110:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ab8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243918 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.317125:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90acd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243918 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664358.317138:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:2.0:1788664358.317141:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664358.317144:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea200, rc 0) 00000100:00100000:2.0:1788664358.317208:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+15:11318:x1875550204395008:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1446us (1670us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788664358.317216:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 137 00000100:00080000:3.0:1788664358.320615:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664358.336467:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664358.336573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664358.338608:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395264 00000100:00100000:0.0:1788664358.338624:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395264 00000100:00100000:0.0:1788664358.338713:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788664358.338725:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+15:2359:x1875550204395264:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664358.338756:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664358.338793:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90acd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243918 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664358.338817:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:0.0:1788664358.338822:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664358.338890:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+14:2359:x1875550204395264:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 167us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664358.338898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788664358.341899:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395136 00000100:00100000:1.0:1788664358.341912:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395136 00000100:00100000:1.0:1788664358.341987:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 138 00000100:00100000:1.0:1788664358.341997:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+14:11318:x1875550204395136:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788664358.342298:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+14:11318:x1875550204395136:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 Request processed in 302us (5841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664358.342307:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 138 00010000:00010000:2.0:1788664358.687486:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664359.088734:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664359.088744:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664359.092069:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788664359.092093:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664359.714940:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222231424:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715026:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664359.715105:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231424 00000100:00100000:3.0:1788664359.715113:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231424 00000100:00100000:3.0:1788664359.715158:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788664359.715167:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222231424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715221:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222231424:12345-0@lo:400:kworker.0 Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664359.715228:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788664359.715276:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222231424:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715312:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222231552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715363:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664359.715407:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231552 00000100:00100000:3.0:1788664359.715412:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231552 00000100:00100000:3.0:1788664359.715440:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788664359.715447:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222231552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715493:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222231552:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664359.715499:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788664359.715537:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222231552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715578:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664359.715586:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222231680:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715611:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664359.715634:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231680 00000100:00100000:3.0:1788664359.715638:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231680 00000100:00100000:3.0:1788664359.715666:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788664359.715672:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222231680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715705:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222231680:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664359.715711:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1788664359.715890:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664359.715915:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222231680:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715964:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222231936:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.715989:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664359.716016:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231936 00000100:00100000:3.0:1788664359.716019:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231936 00000100:00100000:3.0:1788664359.716045:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788664359.716052:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222231936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.716085:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222231936:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664359.716091:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788664359.716113:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664359.716130:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222231936:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.716161:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222232064:0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.716200:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664359.716229:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222232064 00000100:00100000:3.0:1788664359.716233:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222232064 00000100:00100000:3.0:1788664359.716263:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788664359.716269:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222232064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.716302:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222232064:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664359.716308:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788664359.716320:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664359.716338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222232064:0@lo:400:kworker.0 00000100:00100000:2.0:1788664359.716852:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222231808:0@lo:400:kworker.0 00000100:00100000:2.0:1788664359.716885:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664359.716951:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222231808 00000100:00100000:3.0:1788664359.716956:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222231808 00000100:00100000:3.0:1788664359.717026:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788664359.717033:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222231808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664359.717072:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222231808:12345-0@lo:400:kworker.0 Request processed in 40us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664359.717078:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:1.0:1788664359.717225:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664359.734640:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222231808:0@lo:400:kworker.0 00000100:00100000:1.0:1788664360.237015:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664360.237046:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222232192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664360.237115:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664360.237254:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222232192 00000100:00100000:1.0:1788664360.237262:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222232192 00000100:00100000:1.0:1788664360.237303:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788664360.237311:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222232192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664360.237376:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664360.237422:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222232192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664360.237434:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788664360.237489:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222232192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788664360.736419:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788664361.365132:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:2.0:1788664361.417680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664361.417720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664361.417788:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664361.417817:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395520 00000100:00100000:2.0:1788664361.417826:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395520 00000100:00100000:2.0:1788664361.417900:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 161 00000100:00100000:2.0:1788664361.417911:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2361:x1875550204395520:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664361.417987:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2361:x1875550204395520:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664361.417995:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 161 00000100:00080000:2.0:1788664361.418025:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664361.418525:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395392 00000100:00100000:1.0:1788664361.418530:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395392 00000100:00100000:1.0:1788664361.418565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 298 00000100:00100000:1.0:1788664361.418573:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204395392:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664361.418614:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204395392:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 41us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664361.418620:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 298 00000100:00100000:1.0:1788664361.418649:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395648 00000100:00100000:1.0:1788664361.418652:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395648 00000100:00100000:1.0:1788664361.418696:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:1.0:1788664361.418704:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204395648:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664361.418731:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204395648:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664361.418737:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00080000:1.0:1788664361.418765:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664361.426219:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664361.426269:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664361.426364:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395776 00000100:00100000:3.0:1788664361.426374:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395776 00000100:00100000:3.0:1788664361.426447:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:3.0:1788664361.426457:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2357:x1875550204395776:12345-192.168.202.14@tcp:9:kworker.0 00000020:00000080:3.0:1788664361.426487:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be9049f 00000100:00080000:3.0:1788664361.426496:0:6696:0:(import.c:65:import_set_state_nolock()) ffff9b68c91cc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788664361.426542:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:3.0:1788664361.426809:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+2:2357:x1875550204395776:12345-192.168.202.14@tcp:9:kworker.0 Request processed in 352us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664361.426828:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788664361.427006:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204395904 00000100:00100000:1.0:1788664361.427011:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204395904 00000100:00100000:1.0:1788664361.427055:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 162 00000100:00100000:1.0:1788664361.427063:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2360:x1875550204395904:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664361.427105:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8cdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2360:x1875550204395904:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 43us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664361.427112:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 162 00000100:00080000:0.0:1788664361.427234:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664361.427239:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788664361.427323:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664361.617113:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664361.626698:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204396032 00000100:00100000:2.0:1788664361.626713:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204396032 00000100:00100000:2.0:1788664361.626792:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 139 00000100:00100000:2.0:1788664361.626803:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:11361:x1875550204396032:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664361.626823:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664361.626852:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24391f expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.626922:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.626936:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.626951:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.626966:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.626973:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.626990:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627194:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627203:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627222:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627229:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664361.627233:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627240:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627253:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:2.0:1788664361.627256:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664361.627261:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627268:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627280:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627286:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627292:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627297:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664361.627300:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627316:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627325:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b68e9afff00) 00010000:00010000:2.0:1788664361.627327:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664361.627330:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627336:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90ae9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627393:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90adb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24391f expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627405:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:2.0:1788664361.627407:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664361.627412:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24391f expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.627421:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea000, rc 0) 00000100:00100000:2.0:1788664361.636617:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+13:11361:x1875550204396032:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 9806us (19503us total) trans 0 rc 301/301 00000100:00100000:2.0:1788664361.636632:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 139 00000100:00100000:0.0:1788664361.659761:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664361.659895:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204396288 00000100:00100000:1.0:1788664361.659905:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204396288 00000100:00100000:1.0:1788664361.659987:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 140 00000100:00100000:1.0:1788664361.659997:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:11361:x1875550204396288:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:1.0:1788664361.660058:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664361.660084:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243758 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.660101:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:1.0:1788664361.660106:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664361.660304:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.660318:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.660327:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.660382:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.660396:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 5 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664361.660410:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222232320:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664361.660492:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eeacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664361.663898:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664361.664040:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204396416 00000100:00100000:3.0:1788664361.664050:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204396416 00010000:00010000:3.0:1788664361.664088:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 6 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664361.664138:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:3.0:1788664361.664148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2360:x1875550204396416:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664361.664162:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664361.664169:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 6 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.664181:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 6 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.664199:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:3.0:1788664361.664204:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.664213:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.664220:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.664237:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664361.664281:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2360:x1875550204396416:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 134us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664361.664303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00010000:00010000:1.0:1788664361.666027:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ab1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243911 expref: 5 pid: 5856 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664361.666062:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222232320:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664361.666084:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.666094:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.666099:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.666139:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.666150:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.666158:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664361.671973:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788664361.671996:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.672008:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.672017:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.672023:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3c00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664361.672036:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.672045:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.672063:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e9aff000) 00010000:00010000:1.0:1788664361.672066:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664361.672071:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.672078:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90af0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664361.672099:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000095d88e37 reply state 000000009fce4762 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664361.672109:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664361.672745:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+14:11361:x1875550204396288:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 12745us (12988us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788664361.672755:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 140 00010000:00010000:2.0:1788664361.702373:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.702392:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.702413:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.702420:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664361.702427:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.702435:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.702453:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b68dc969600) 00010000:00010000:2.0:1788664361.702457:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664361.702462:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.702469:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90af7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.759609:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664361.859642:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664361.859679:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204396544 00000100:00100000:0.0:1788664361.859688:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204396544 00000100:00100000:0.0:1788664361.859740:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 141 00000100:00100000:0.0:1788664361.859750:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+13:11369:x1875550204396544:12345-192.168.202.14@tcp:101:lctl.0 00010000:00010000:0.0:1788664361.863062:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664361.863108:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243926 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664361.863187:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664361.863209:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664361.863222:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664361.863263:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788664361.863268:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664361.863294:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664361.863322:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243926 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664361.863338:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243926 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664361.863363:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:0.0:1788664361.863367:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664361.863371:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efe00, rc 0) 00000100:00100000:0.0:1788664361.863436:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+14:11369:x1875550204396544:12345-192.168.202.14@tcp:101:lctl.0 Request processed in 3687us (3801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664361.863444:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 141 00000100:00100000:0.0:1788664361.958825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664361.958882:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204396672 00000100:00100000:3.0:1788664361.958892:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204396672 00000100:00100000:3.0:1788664361.958957:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00100000:3.0:1788664361.958976:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+14:11375:x1875550204396672:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788664361.958998:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664361.959020:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24392d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959106:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959120:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959129:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959143:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959150:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959157:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959616:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959643:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959651:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664361.959692:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788664361.959697:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664361.959719:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959731:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959737:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959743:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959749:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664361.959753:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959760:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959770:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:3.0:1788664361.959774:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664361.959778:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959806:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90b13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959820:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959826:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959832:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959837:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664361.959840:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959846:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959854:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b68c3811100) 00010000:00010000:3.0:1788664361.959857:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664361.959859:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959864:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959896:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24392d expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959909:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90b21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24392d expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664361.959922:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:3.0:1788664361.959925:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788664361.959927:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b200, rc 0) 00000100:00100000:3.0:1788664361.960308:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+15:11375:x1875550204396672:12345-192.168.202.14@tcp:101:bash.0 Request processed in 1332us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664361.960316:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 142 00000100:00100000:0.0:1788664361.971086:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664361.971177:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204396928 00000100:00100000:1.0:1788664361.971188:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204396928 00000100:00100000:1.0:1788664361.971250:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 143 00000100:00100000:1.0:1788664361.971261:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+15:11375:x1875550204396928:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788664361.971284:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664361.971306:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3400/0x762f55027be90b28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243934 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.971496:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.971527:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664361.971539:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.981808:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.981843:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.981856:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664361.982832:0:7653:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788664361.983215:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983238:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983246:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983289:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983296:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983304:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983310:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664361.983315:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983322:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983335:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664361.983338:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664361.983362:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983369:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be90b2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664361.983383:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a10eb11b reply state 00000000ec114ce3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664361.983397:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788664361.983440:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3400/0x762f55027be90b28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983455:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 17 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.983462:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664361.983464:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664361.983467:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea200, rc 0) 00000100:00100000:2.0:1788664361.984158:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+18:11375:x1875550204396928:12345-192.168.202.14@tcp:101:bash.0 Request processed in 12897us (13091us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788664361.984168:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 143 00010000:00010000:2.0:1788664361.998882:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.998900:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.998907:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.998913:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664361.998918:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.998938:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.998979:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68e9afff00) 00010000:00010000:2.0:1788664361.998982:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664361.998998:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664361.999006:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90b36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664362.001682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664362.001816:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204397056 00000100:00100000:3.0:1788664362.001826:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204397056 00000100:00100000:3.0:1788664362.001873:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:3.0:1788664362.001881:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875550204397056:12345-192.168.202.14@tcp:8:bash.0 00010000:00080000:3.0:1788664362.001917:0:8476:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:3.0:1788664362.001961:0:8476:0:(genops.c:1385:class_connect()) connect: client 5e600724-38bd-4119-be7d-5264f08f0aa5, cookie 0x762f55027be90b4b 00002000:00100000:3.0:1788664362.001973:0:8476:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5e600724-38bd-4119-be7d-5264f08f0aa5/ffff9b68dff25000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788664362.001984:0:8476:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b6, return b6 00002000:00080000:3.0:1788664362.002126:0:8476:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788664362.002301:0:8476:0:(import.c:65:import_set_state_nolock()) ffff9b68dff22000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664362.002410:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2357:x1875550204397056:12345-192.168.202.14@tcp:8:bash.0 Request processed in 527us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664362.002421:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788664362.006985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.007174:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204397184 00000100:00100000:1.0:1788664362.007185:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204397184 00000100:00100000:1.0:1788664362.007256:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:1.0:1788664362.007267:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+6:0:x1875550204397184:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:1.0:1788664362.007286:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664362.007307:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24393b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664362.007335:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664362.007388:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788664362.007392:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664362.007403:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.007425:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.007438:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3400, rc 0) 00000100:00100000:1.0:1788664362.007496:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:0:x1875550204397184:12345-192.168.202.14@tcp:101:bash.0 Request processed in 231us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664362.007518:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00080000:0.0:1788664362.008601:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664362.024212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664362.024382:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204397312 00000100:00100000:0.0:1788664362.024392:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204397312 00000100:00100000:0.0:1788664362.024453:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:0.0:1788664362.024463:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:11375:x1875550204397312:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664362.024483:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664362.024501:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243942 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.024533:0:12075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.024544:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788664362.024548:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664362.024554:0:12075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.024592:0:12075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.024606:0:12075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 8 pid: 6694 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664362.024619:0:12075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1875550222232448:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664362.024719:0:12075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3f09600 going to sleep for 11 seconds 00000100:00100000:0.0:1788664362.040603:0:12075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12075:1875550222232448:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664362.040644:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.040694:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee200, rc 0) 00000100:00100000:0.0:1788664362.040763:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+8:11375:x1875550204397312:12345-192.168.202.14@tcp:101:bash.0 Request processed in 16301us (16560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664362.040781:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:1.0:1788664362.052118:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664362.052299:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204397440 00000100:00100000:0.0:1788664362.052308:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204397440 00010000:00010000:0.0:1788664362.052388:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 8 pid: 6694 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664362.052431:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:0.0:1788664362.052442:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204397440:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664362.052458:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664362.052480:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 8 pid: 6694 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.052492:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 8 pid: 6694 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.052515:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d78a66ce/0x762f55027be90b52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24393b expref: 8 pid: 6694 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.052530:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664362.052535:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664362.052544:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 7 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.052568:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 7 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.052608:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 7 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664362.052624:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5840:1875550222232576:192.168.202.14@tcp:105: 00000100:00100000:3.0:1788664362.053098:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3f09600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664362.060059:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.060196:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204397696 00000100:00100000:1.0:1788664362.060207:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204397696 00000100:00100000:1.0:1788664362.060268:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:1.0:1788664362.060280:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+17:11375:x1875550204397696:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:1.0:1788664362.060679:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+18:11375:x1875550204397696:12345-192.168.202.14@tcp:35:bash.0 Request processed in 400us (630us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788664362.060688:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:3.0:1788664362.061517:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5840:1875550222232576:192.168.202.14@tcp:105: 00010000:00010000:3.0:1788664362.061607:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664362.061650:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204397440:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 9209us (9542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664362.061692:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:2.0:1788664362.197692:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664362.198171:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204397952 00000100:00100000:3.0:1788664362.198181:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204397952 00000100:00100000:3.0:1788664362.198243:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 144 00000100:00100000:3.0:1788664362.198253:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+18:11385:x1875550204397952:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664362.198276:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664362.198296:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90b60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243949 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664362.198427:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788664362.198548:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90b60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243949 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.198564:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:3.0:1788664362.198567:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664362.198572:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90b60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243949 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.198587:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a200, rc 0) 00000100:00100000:3.0:1788664362.198661:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11385:x1875550204397952:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 409us (977us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788664362.198669:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 144 00000100:00100000:2.0:1788664362.205103:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.205195:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204398208 00000100:00100000:1.0:1788664362.205204:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204398208 00000100:00100000:1.0:1788664362.205260:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:1.0:1788664362.205269:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11385:x1875550204398208:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788664362.205537:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11385:x1875550204398208:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 268us (543us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788664362.205545:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:0.0:1788664362.359993:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.360185:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204398336 00000100:00100000:1.0:1788664362.360195:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204398336 00000100:00100000:1.0:1788664362.360258:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 145 00000100:00100000:1.0:1788664362.360269:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11391:x1875550204398336:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664362.360294:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664362.360314:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243950 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.360433:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.360462:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.360488:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664362.360537:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788664362.360541:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664362.360560:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.360590:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243950 expref: 22 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.360609:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243950 expref: 21 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.360617:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:1.0:1788664362.360620:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664362.360624:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3000, rc 0) 00000100:00100000:1.0:1788664362.360676:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+21:11391:x1875550204398336:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 408us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664362.360683:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 145 00000100:00100000:0.0:1788664362.381636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664362.381743:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204398592 00000100:00100000:3.0:1788664362.381754:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204398592 00000100:00100000:3.0:1788664362.381815:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:3.0:1788664362.381826:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+21:11391:x1875550204398592:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664362.381861:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664362.381896:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90b7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243957 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.382032:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.382046:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.382058:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664362.382070:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788664362.382207:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243957 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.382228:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243957 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.382238:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:3.0:1788664362.382241:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664362.382244:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a600, rc 0) 00000100:00100000:3.0:1788664362.382307:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+23:11391:x1875550204398592:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 484us (689us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788664362.382314:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 146 00000100:00100000:0.0:1788664362.391517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664362.391825:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204398976 00000100:00100000:3.0:1788664362.391835:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204398976 00000100:00100000:3.0:1788664362.391912:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788664362.391936:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+23:2360:x1875550204398976:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664362.391955:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664362.391993:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243957 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.392024:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:3.0:1788664362.392033:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664362.392090:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+22:2360:x1875550204398976:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 156us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664362.392098:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788664362.404250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.404382:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204398848 00000100:00100000:1.0:1788664362.404393:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204398848 00000100:00100000:1.0:1788664362.404453:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00100000:1.0:1788664362.404464:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+22:11391:x1875550204398848:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664362.404491:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664362.404527:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90b91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24395e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.404654:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90b98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.404669:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.404682:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664362.404945:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788664362.405082:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90b91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24395e expref: 25 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.405101:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24395e expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.405110:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:1.0:1788664362.405113:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788664362.405116:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2200, rc 0) 00000100:00100000:1.0:1788664362.405168:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11391:x1875550204398848:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 706us (927us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788664362.405175:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 147 00000100:00100000:2.0:1788664362.432080:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664362.432234:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204399104 00000100:00100000:3.0:1788664362.432244:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204399104 00000100:00100000:3.0:1788664362.432308:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:3.0:1788664362.432320:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204399104:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:3.0:1788664362.432404:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.432427:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 7 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.432436:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664362.432441:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664362.432446:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.432480:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 7 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.432510:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 7 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664362.432525:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875550222232704:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664362.432629:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664362.462919:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.463492:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204399232 00000100:00100000:1.0:1788664362.463504:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204399232 00002000:00100000:1.0:1788664362.463559:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b68c60d2300 x1875550204399232/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:668/0 lens 504/0 e 0 to 0 dl 1788664373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664362.463570:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c60d2300 with x1875550204399232 ext(0->12) 00010000:00010000:1.0:1788664362.463605:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 8 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.463625:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 8 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664362.463633:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68c60d2300 00000100:00100000:1.0:1788664362.463670:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:1.0:1788664362.463679:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204399232:12345-192.168.202.14@tcp:4:lfs.0 00000100:00100000:3.0:1788664362.480540:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f29c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6697:1875550222232704:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664362.480571:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788664362.565122:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000001:00100000:0.0:1788664362.565136:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:0.0:1788664362.565140:0:7657:0:(genops.c:885:class_export_put()) final put ffff9b68c91c8800/5e600724-38bd-4119-be7d-5264f08f0aa5 00000100:00100000:1.0:1788664362.566438:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204399232:12345-192.168.202.14@tcp:4:lfs.0 Request processed in 102752us (103520us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788664362.566452:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00002000:00100000:1.0:1788664362.566465:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b68c60d2300 x1875550204399232/t4294967305(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:668/0 lens 504/448 e 0 to 0 dl 1788664373 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788664362.566475:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c60d2300 with x1875550204399232 ext(0->12) 00010000:00010000:1.0:1788664362.566486:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 9 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.566506:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 9 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664362.566514:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68c60d2300 00000020:00000080:3.0:1788664362.567504:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68c91c8800/5e600724-38bd-4119-be7d-5264f08f0aa5 for lustre-OST0001 00000020:00000080:3.0:1788664362.567558:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68c91cc000 for lustre-OST0001 00000100:00100000:2.0:1788664362.573391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.573557:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204399360 00000100:00100000:1.0:1788664362.573569:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204399360 00010000:00010000:1.0:1788664362.573624:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 9 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664362.573709:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:1.0:1788664362.573720:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2358:x1875550204399360:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664362.573737:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788664362.573761:0:7644:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788664362.573765:0:7644:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788664362 00002000:00010000:1.0:1788664362.573767:0:7644:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788664363 00002000:00010000:1.0:1788664362.573769:0:7644:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788664362 00010000:00010000:1.0:1788664362.573776:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 9 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.573791:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 9 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.573820:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077637a60/0x762f55027be90b59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243942 expref: 9 pid: 12075 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.573838:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664362.573844:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664362.573853:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.573864:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.573902:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664362.573969:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2358:x1875550204399360:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 251us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664362.573977:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00010000:00010000:2.0:1788664362.574312:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574323:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574376:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574385:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574392:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574407:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664362.574411:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574420:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574433:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.574440:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baaa6eb7/0x762f55027be90ba6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664362.574525:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204399104:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 142206us (142454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664362.574534:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:2.0:1788664362.581777:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.582545:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204399616 00000100:00100000:1.0:1788664362.582556:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204399616 00000100:00100000:1.0:1788664362.582613:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:1.0:1788664362.582624:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11391:x1875550204399616:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:1.0:1788664362.582717:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24395e expref: 24 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664362.582994:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788664362.583058:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788664362.583554:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788664362.583611:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.583625:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 28 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.583635:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.583669:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 28 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.583684:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 28 pid: 7653 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664362.583711:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5857:1875550222232832:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664362.583824:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664362.597066:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5857:1875550222232832:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664362.597098:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664362.597629:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664362.598822:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204399744 00000100:00100000:3.0:1788664362.598832:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204399744 00010000:00010000:3.0:1788664362.598887:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 29 pid: 7653 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664362.598939:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:3.0:1788664362.598949:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+29:2361:x1875550204399744:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664362.598965:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664362.598973:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 29 pid: 7653 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.598997:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 29 pid: 7653 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.599042:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243934 expref: 29 pid: 7653 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.599059:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:3.0:1788664362.599065:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.599074:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.599081:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.599311:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664362.599462:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+28:2361:x1875550204399744:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 513us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664362.599470:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00010000:00010000:1.0:1788664362.600713:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.600725:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664362.600853:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788664362.601080:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788664362.601194:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222232960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664362.601251:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664362.601287:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf240 going to sleep for 11 seconds 00000100:00100000:3.0:1788664362.607304:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222232960 00000100:00100000:3.0:1788664362.607330:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222232960 00000100:00100000:3.0:1788664362.607446:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664362.607456:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222232960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788664362.607598:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222232960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (6346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664362.607605:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664362.607759:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222232960:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788664362.608061:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788664362.608301:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788664362.608415:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222233088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788664362.608454:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664362.608475:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664362.608866:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222233088 00000100:00100000:0.0:1788664362.608872:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222233088 00000100:00100000:0.0:1788664362.608898:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664362.608905:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222233088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788664362.609102:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1875550222233088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 196us (646us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788664362.609108:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664362.611576:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222233088:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788664362.611702:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788664362.611768:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.611792:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.611801:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.611807:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3c00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664362.611812:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.611819:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.611836:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664362.611839:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788664362.611854:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.611861:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90bad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788664362.613188:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788664362.613297:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788664362.613307:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396596965194ns, next at 397596963270ns, rc = 0 00000001:00080000:2.0:1788664362.613315:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788664362.618256:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664362.618267:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788664362.618293:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90b98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24395e expref: 32 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664362.618470:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:11391:x1875550204399616:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 35846us (36703us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788664362.618480:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000020:00080000:2.0:1788664362.618486:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788664362.623274:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664362.625376:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204399872 00000100:00100000:0.0:1788664362.625404:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204399872 00000100:00100000:0.0:1788664362.625462:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 148 00000100:00100000:0.0:1788664362.625472:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:11391:x1875550204399872:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664362.625497:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664362.625532:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243965 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.625608:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243965 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.625623:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243965 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664362.625643:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:0.0:1788664362.625646:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664362.625650:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee600, rc 0) 00000100:00100000:0.0:1788664362.626124:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11391:x1875550204399872:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 652us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664362.626133:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 148 00000100:00100000:0.0:1788664362.632031:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664362.633477:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204400128 00000100:00100000:2.0:1788664362.633490:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204400128 00000100:00100000:2.0:1788664362.633552:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788664362.633571:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11391:x1875550204400128:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664362.633829:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+33:11391:x1875550204400128:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 258us (1822us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788664362.633837:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00010000:00010000:2.0:1788664362.783718:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664362.794089:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664362.794294:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204400384 00000100:00100000:2.0:1788664362.794305:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204400384 00000100:00100000:2.0:1788664362.794400:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 149 00000100:00100000:2.0:1788664362.794411:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+33:11401:x1875550204400384:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664362.794444:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664362.794484:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24396c expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664362.794604:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788664362.794746:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90bbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24396c expref: 35 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.794783:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:2.0:1788664362.794787:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664362.794793:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24396c expref: 35 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.794807:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea000, rc 0) 00000100:00100000:2.0:1788664362.794881:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11401:x1875550204400384:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 471us (802us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788664362.794889:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 149 00000100:00100000:0.0:1788664362.802299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.802408:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204400512 00000100:00100000:1.0:1788664362.802421:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204400512 00000100:00100000:1.0:1788664362.802498:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 150 00000100:00100000:1.0:1788664362.802509:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11401:x1875550204400512:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:1.0:1788664362.802607:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802625:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802638:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802653:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802692:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802700:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802794:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802804:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802811:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664362.802870:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802883:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802891:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802897:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.802903:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2e00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664362.802909:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803078:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803095:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:1.0:1788664362.803098:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664362.803103:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803109:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90bc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803124:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803129:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803134:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803138:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664362.803140:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803146:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803152:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68dc969d00) 00010000:00010000:1.0:1788664362.803154:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664362.803157:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803162:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90bd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803185:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803190:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803196:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803201:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664362.803204:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803210:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803216:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664362.803219:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664362.803221:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664362.803226:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be90bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664362.804291:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11401:x1875550204400512:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1779us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664362.804302:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 150 00000100:00100000:0.0:1788664362.818189:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.818271:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204400768 00000100:00100000:1.0:1788664362.818280:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204400768 00000100:00100000:1.0:1788664362.818336:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:1.0:1788664362.818380:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11401:x1875550204400768:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788664362.818633:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+35:11401:x1875550204400768:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 254us (452us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788664362.818641:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:3.0:1788664362.907639:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664362.907813:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204401024 00000100:00100000:2.0:1788664362.907825:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204401024 00000100:00100000:2.0:1788664362.907911:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00100000:2.0:1788664362.907922:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+35:11404:x1875550204401024:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664362.907949:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664362.907974:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243973 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908078:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908095:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908108:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908127:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908151:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908159:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908298:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908307:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908314:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664362.908325:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788664362.908474:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908854:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908863:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908869:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664362.908874:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.908883:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909069:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664362.909072:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664362.909077:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909083:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909098:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909105:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909112:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909117:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664362.909120:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909125:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909133:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664362.909136:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664362.909139:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909144:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90bec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909211:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 38 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909224:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 37 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664362.909231:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:2.0:1788664362.909234:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664362.909236:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb600, rc 0) 00000100:00100000:2.0:1788664362.909391:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+37:11404:x1875550204401024:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1470us (1760us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788664362.909399:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 151 00000100:00100000:0.0:1788664362.940237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664362.940364:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204401152 00000100:00100000:3.0:1788664362.940386:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204401152 00000100:00100000:3.0:1788664362.940449:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 152 00000100:00100000:3.0:1788664362.940459:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+37:11404:x1875550204401152:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:3.0:1788664362.940534:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.940884:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941186:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941218:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941225:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941232:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941238:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664362.941243:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941250:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941262:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:3.0:1788664362.941265:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664362.941270:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664362.941290:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664362.941451:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+37:11404:x1875550204401152:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 992us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664362.941459:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 152 00000100:00100000:2.0:1788664362.961426:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664362.961730:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204401408 00000100:00100000:1.0:1788664362.961742:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204401408 00000100:00100000:1.0:1788664362.961809:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:1.0:1788664362.961821:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+37:11404:x1875550204401408:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788664362.962527:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+38:11404:x1875550204401408:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 705us (1109us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788664362.962544:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:0.0:1788664363.301969:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664363.301999:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222233216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664363.302085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664363.302233:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222233216 00000100:00100000:2.0:1788664363.302252:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222233216 00000100:00100000:2.0:1788664363.302324:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664363.302337:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222233216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664363.302413:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664363.302466:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222233216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664363.302474:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664363.302520:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222233216:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664363.302735:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664363.658762:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664363.658861:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204401664 00000100:00100000:0.0:1788664363.658884:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204401664 00000100:00100000:0.0:1788664363.658960:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 153 00000100:00100000:0.0:1788664363.658971:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+38:11435:x1875550204401664:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:0.0:1788664363.659001:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664363.659023:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24397a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.659130:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.659145:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.659159:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664363.659171:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788664363.659323:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24397a expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.659386:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24397a expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664363.659396:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:0.0:1788664363.659399:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664363.659403:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efc00, rc 0) 00000100:00100000:0.0:1788664363.659462:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+40:11435:x1875550204401664:12345-192.168.202.14@tcp:101:cat.0 Request processed in 492us (709us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788664363.659481:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 153 00000100:00080000:1.0:1788664363.660487:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664363.671925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664363.671978:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664363.672162:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204401920 00000100:00100000:2.0:1788664363.672173:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204401920 00000100:00100000:2.0:1788664363.672249:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:2.0:1788664363.672264:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+40:11435:x1875550204401920:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:2.0:1788664363.672667:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+41:11435:x1875550204401920:12345-192.168.202.14@tcp:35:cat.0 Request processed in 409us (751us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788664363.672676:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:1.0:1788664363.672920:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204402048 00000100:00100000:1.0:1788664363.672925:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204402048 00000100:00100000:1.0:1788664363.672969:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:1.0:1788664363.672977:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+41:2358:x1875550204402048:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664363.672998:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664363.673031:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24397a expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.673050:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664363.673055:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664363.673077:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5890c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+40:2358:x1875550204402048:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 101us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664363.673084:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00010000:00010000:0.0:1788664363.810190:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664363.811651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664363.811793:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204402304 00000100:00100000:1.0:1788664363.811804:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204402304 00000100:00100000:1.0:1788664363.811882:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 154 00000100:00100000:1.0:1788664363.811893:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+40:11441:x1875550204402304:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:1.0:1788664363.811919:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664363.811922:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788664363.811953:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be90b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243950 expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.811973:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:1.0:1788664363.811980:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664363.811994:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243981 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.812105:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.812119:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 40 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.812127:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.812175:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 40 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.812190:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 40 pid: 7653 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664363.812225:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222233344:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664363.812324:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664363.816053:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664363.816292:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204402432 00000100:00100000:3.0:1788664363.816302:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204402432 00010000:00010000:3.0:1788664363.816336:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 41 pid: 7653 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664363.816399:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:3.0:1788664363.816410:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+41:2360:x1875550204402432:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664363.816431:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664363.816439:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 41 pid: 7653 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664363.816452:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 41 pid: 7653 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664363.816482:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:3.0:1788664363.816489:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664363.816499:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664363.816508:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664363.816550:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664363.816655:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+41:2360:x1875550204402432:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 246us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664363.816664:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00010000:00010000:1.0:1788664363.817736:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243973 expref: 40 pid: 7653 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664363.817755:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222233344:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664363.817777:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.817787:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.817793:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664363.817814:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788664363.817983:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.817999:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.818008:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664363.818011:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788664363.818014:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2e00, rc 0) 00000100:00100000:1.0:1788664363.818049:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+40:11441:x1875550204402304:12345-192.168.202.14@tcp:101:dd.0 Request processed in 6158us (6406us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788664363.818068:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 154 00000100:00100000:0.0:1788664363.825485:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664363.825619:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204402688 00000100:00100000:1.0:1788664363.825642:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204402688 00000100:00100000:1.0:1788664363.825724:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 155 00000100:00100000:1.0:1788664363.825734:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+40:11441:x1875550204402688:12345-192.168.202.14@tcp:36:dd.0 00010000:00010000:1.0:1788664363.826090:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.826109:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.826122:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664363.826176:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788664363.826207:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8defd8b reply state 0000000029cd0b09 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664363.826216:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664363.826305:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+43:11441:x1875550204402688:12345-192.168.202.14@tcp:36:dd.0 Request processed in 572us (856us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788664363.826313:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 155 00000020:00080000:1.0:1788664363.826317:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788664363.836983:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.837002:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.837020:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.837047:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664363.837053:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.837062:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.837082:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664363.837086:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664363.837091:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664363.837097:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be90c32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664364.345815:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664364.346023:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204402816 00000100:00100000:3.0:1788664364.346033:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204402816 00000100:00100000:3.0:1788664364.346089:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 156 00000100:00100000:3.0:1788664364.346098:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+42:11455:x1875550204402816:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:3.0:1788664364.346122:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664364.346142:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243988 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346209:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346234:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346253:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346268:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346275:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346282:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346566:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346579:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 43 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346588:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346624:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 43 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.346640:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 43 pid: 5855 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664364.346654:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222233472:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664364.346766:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664364.358051:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664364.358160:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204403072 00000100:00100000:0.0:1788664364.358170:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204403072 00000100:00100000:0.0:1788664364.358245:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:0.0:1788664364.358257:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+44:5600:x1875550204403072:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788664364.359079:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+45:5600:x1875550204403072:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 820us (1035us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788664364.359089:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:3.0:1788664364.359222:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f29180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222233472:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664364.359249:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664364.362949:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664364.363446:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204403200 00000100:00100000:1.0:1788664364.363485:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204403200 00010000:00010000:1.0:1788664364.363534:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 45 pid: 5855 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664364.363579:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:1.0:1788664364.363589:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+45:2360:x1875550204403200:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664364.363606:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664364.363614:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 45 pid: 5855 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.364769:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 45 pid: 5855 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.364931:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243981 expref: 45 pid: 5855 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.364950:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664364.364956:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.364966:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.364974:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.365000:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664364.365072:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+44:2360:x1875550204403200:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1483us (2454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664364.365081:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00010000:00010000:3.0:1788664364.366717:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.366732:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664364.366806:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788664364.366825:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664364.367212:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367230:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367242:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367249:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367256:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367263:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664364.367269:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367278:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367292:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:3.0:1788664364.367294:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664364.367298:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367304:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90c40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367319:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.367334:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369027:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369045:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664364.369050:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369060:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369075:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68c3811100) 00010000:00010000:3.0:1788664364.369079:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664364.369083:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369090:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369154:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243988 expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369169:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243988 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664364.369177:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:3.0:1788664364.369180:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664364.369198:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1478200, rc 0) 00000100:00100000:3.0:1788664364.369286:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+43:11455:x1875550204402816:12345-192.168.202.14@tcp:101:stat.0 Request processed in 23187us (23484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664364.369297:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 156 00000100:00100000:0.0:1788664364.533141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664364.535436:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204403456 00000100:00100000:1.0:1788664364.535451:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204403456 00000100:00100000:1.0:1788664364.535529:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 157 00000100:00100000:1.0:1788664364.535540:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+43:11461:x1875550204403456:12345-192.168.202.14@tcp:36:truncate.0 00010000:00010000:1.0:1788664364.536133:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664364.536162:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243988 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.536184:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664364.536190:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664364.536861:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.536878:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.536888:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664364.536941:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788664364.536971:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7bce1d4 reply state 00000000f4859ec6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664364.536980:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664364.537097:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+45:11461:x1875550204403456:12345-192.168.202.14@tcp:36:truncate.0 Request processed in 1558us (3965us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788664364.537105:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 157 00000020:00080000:1.0:1788664364.537110:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788664364.550371:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664364.550391:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664364.550399:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664364.550406:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2e00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664364.550411:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664364.550420:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664364.550465:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:0.0:1788664364.550468:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664364.550474:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664364.550482:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90c55 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664364.853747:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664364.870105:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222233984:0@lo:400:kworker.0 00000100:00100000:1.0:1788664364.870181:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664364.870262:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664364.870269:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222233856:0@lo:400:kworker.0 00000100:00100000:1.0:1788664364.870307:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664364.870483:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222233856 00000100:00100000:1.0:1788664364.870492:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222233856 00000100:00100000:0.0:1788664364.870870:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222233728:0@lo:400:kworker.0 00000100:00100000:0.0:1788664364.870903:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664364.870925:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222234240:0@lo:400:kworker.0 00000100:00100000:0.0:1788664364.870946:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664364.870968:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788664364.870973:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222233600:0@lo:400:kworker.0 00000100:00100000:0.0:1788664364.870997:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664364.871015:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222234112:0@lo:400:kworker.0 00000100:00100000:0.0:1788664364.871046:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664364.871074:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222233984 00000100:00100000:0.0:1788664364.871078:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222233984 00000100:00100000:0.0:1788664364.871106:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222234240 00000100:00100000:0.0:1788664364.871109:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222234240 00000100:00100000:0.0:1788664364.871130:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788664364.871139:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222233984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664364.871192:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222233984:12345-0@lo:400:kworker.0 Request processed in 54us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664364.871199:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788664364.871979:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788664364.871996:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222233856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664364.872041:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222233856:12345-0@lo:400:kworker.0 Request processed in 51us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664364.872063:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788664364.872080:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222233728 00000100:00100000:1.0:1788664364.872085:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222233728 00000100:00100000:1.0:1788664364.872101:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222234112 00000100:00100000:1.0:1788664364.872103:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222234112 00000100:00100000:1.0:1788664364.872119:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788664364.872125:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222233728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664364.872165:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222233728:12345-0@lo:400:kworker.0 Request processed in 40us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664364.872171:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788664364.872182:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788664364.872189:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222234112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664364.872400:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788664364.872411:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222234240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664364.872444:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222234240:12345-0@lo:400:kworker.0 Request processed in 36us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664364.872449:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788664364.872486:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664364.872491:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664364.872518:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222233728:0@lo:400:kworker.0 00000100:00100000:2.0:1788664364.872540:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222234240:0@lo:400:kworker.0 00000100:00100000:3.0:1788664364.872961:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222233856:0@lo:400:kworker.0 00000100:00100000:3.0:1788664364.872974:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222233984:0@lo:400:kworker.0 00000100:00100000:0.0:1788664364.873046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222233600 00000100:00100000:0.0:1788664364.873060:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222233600 00000100:00100000:0.0:1788664364.873092:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788664364.873099:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222233600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664364.873136:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222233600:12345-0@lo:400:kworker.0 Request processed in 38us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664364.873143:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788664364.876650:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222234112:12345-0@lo:400:kworker.0 Request processed in 4452us (5604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664364.876665:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788664364.877238:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222233600:0@lo:400:kworker.0 00000100:00100000:2.0:1788664364.877258:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222234112:0@lo:400:kworker.0 00000100:00100000:1.0:1788664364.895178:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664364.895984:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204403584 00000100:00100000:2.0:1788664364.895995:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204403584 00000100:00100000:2.0:1788664364.896060:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 158 00000100:00100000:2.0:1788664364.896071:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+44:11474:x1875550204403584:12345-192.168.202.14@tcp:101:stat.0 00010000:00010000:2.0:1788664364.896097:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664364.896119:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90c5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24398f expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.896222:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.896237:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.896249:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.896264:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.896281:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.896288:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.906900:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.906924:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.906937:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664364.906990:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788664364.906996:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664364.907026:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907058:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907069:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907075:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907082:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907088:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eac00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664364.907092:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907100:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907112:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664364.907115:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664364.907120:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907126:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90c63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907141:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907147:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907160:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907166:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664364.907169:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907175:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907182:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664364.907185:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664364.907188:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907193:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea000/0x762f55027be90c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907250:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 46 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907265:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 45 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664364.907852:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:2.0:1788664364.907854:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664364.907857:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea200, rc 0) 00000100:00100000:2.0:1788664364.907935:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+45:11474:x1875550204403584:12345-192.168.202.14@tcp:101:stat.0 Request processed in 11865us (12767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664364.907955:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 158 00000100:00100000:2.0:1788664365.065910:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.066016:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204403840 00000100:00100000:0.0:1788664365.066027:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204403840 00000100:00100000:0.0:1788664365.066110:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 159 00000100:00100000:0.0:1788664365.066121:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+45:11486:x1875550204403840:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664365.066142:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664365.066163:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243996 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664365.066271:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788664365.066449:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90c78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243996 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.066464:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:0.0:1788664365.066467:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664365.066485:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243996 expref: 47 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.066500:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee200, rc 0) 00000100:00100000:0.0:1788664365.066571:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+46:11486:x1875550204403840:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 452us (670us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788664365.066578:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 159 00000100:00080000:2.0:1788664365.066911:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664365.077282:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664365.078001:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204404096 00000100:00100000:3.0:1788664365.078023:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204404096 00000100:00100000:3.0:1788664365.078090:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:3.0:1788664365.078101:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+46:11486:x1875550204404096:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664365.079028:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+47:11486:x1875550204404096:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 926us (1753us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788664365.079046:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:3.0:1788664365.215788:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.215878:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204404352 00000100:00100000:0.0:1788664365.215888:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204404352 00000100:00100000:0.0:1788664365.215950:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 160 00000100:00100000:0.0:1788664365.215961:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+47:11492:x1875550204404352:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664365.215988:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664365.216021:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90c86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd24399d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.216150:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.216165:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 48 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.216174:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.216208:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 48 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.216222:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 48 pid: 7653 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664365.216245:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222234368:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664365.216382:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3f09600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664365.218928:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.219381:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222234368:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664365.219410:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664365.219719:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204404480 00000100:00100000:3.0:1788664365.219727:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204404480 00010000:00010000:2.0:1788664365.219846:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 49 pid: 7653 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664365.219927:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:2.0:1788664365.219938:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+49:2361:x1875550204404480:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664365.219954:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664365.219962:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 49 pid: 7653 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.219973:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 49 pid: 7653 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.219997:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be90c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24398f expref: 49 pid: 7653 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.220094:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:2.0:1788664365.220100:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.220110:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.220119:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.220190:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664365.220259:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+48:2361:x1875550204404480:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 322us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664365.220268:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00010000:00010000:0.0:1788664365.220566:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.220574:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664365.220594:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788664365.220753:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90c86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.220769:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 48 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.220777:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:0.0:1788664365.220780:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788664365.220782:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664365.220857:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+48:11492:x1875550204404352:12345-192.168.202.14@tcp:101:bash.0 Request processed in 4898us (5079us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788664365.220865:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 160 00000100:00100000:2.0:1788664365.228105:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.228182:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204404736 00000100:00100000:0.0:1788664365.228191:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204404736 00000100:00100000:0.0:1788664365.228260:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 161 00000100:00100000:0.0:1788664365.228271:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+48:11492:x1875550204404736:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:0.0:1788664365.228609:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.228626:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.228650:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664365.228707:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788664365.228736:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cfbe167 reply state 00000000c36c865e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664365.228746:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664365.228839:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+51:11492:x1875550204404736:12345-192.168.202.14@tcp:36:bash.0 Request processed in 570us (744us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788664365.228847:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 161 00000020:00080000:0.0:1788664365.228852:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788664365.242116:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.242134:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.242142:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.242149:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664365.242154:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.242163:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.242180:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:2.0:1788664365.242184:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664365.242189:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664365.242196:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90c9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664365.248772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.249016:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204404864 00000100:00100000:0.0:1788664365.249027:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204404864 00000100:00100000:0.0:1788664365.249081:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 162 00000100:00100000:0.0:1788664365.249091:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+50:11492:x1875550204404864:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664365.249116:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664365.249135:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90ca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439a4 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.249242:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.249258:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.249267:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.249311:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.249324:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 51 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664365.249382:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222234496:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664365.249470:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3f09240 going to sleep for 11 seconds 00000100:00100000:0.0:1788664365.255158:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c612ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222234496:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664365.255190:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664365.261236:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664365.261688:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204404992 00000100:00100000:3.0:1788664365.261698:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204404992 00010000:00010000:3.0:1788664365.261739:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 52 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664365.261782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:3.0:1788664365.261793:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+52:2360:x1875550204404992:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664365.261808:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664365.261817:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 52 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.261848:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 52 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.261870:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90c8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24399d expref: 52 pid: 5854 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.261887:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:3.0:1788664365.261893:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.261903:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.261911:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.261944:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664365.262000:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+51:2360:x1875550204404992:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 209us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664365.262127:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00010000:00010000:0.0:1788664365.262191:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.262200:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664365.262251:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788664365.262257:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664365.262279:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.262333:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90ca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439a4 expref: 51 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.262383:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439a4 expref: 50 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.262404:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:0.0:1788664365.262407:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664365.262409:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef200, rc 0) 00000100:00100000:0.0:1788664365.262440:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+50:11492:x1875550204404864:12345-192.168.202.14@tcp:101:bash.0 Request processed in 13350us (13676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664365.262447:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 162 00000100:00100000:1.0:1788664365.279148:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.279247:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204405248 00000100:00100000:0.0:1788664365.279257:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204405248 00000100:00100000:0.0:1788664365.279319:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:0.0:1788664365.279377:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+50:11492:x1875550204405248:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:0.0:1788664365.279946:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+51:11492:x1875550204405248:12345-192.168.202.14@tcp:35:bash.0 Request processed in 607us (804us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788664365.279954:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000004:00080000:1.0:1788664365.343544:0:7960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399327198516ns, next at 400327195767ns, rc = 0 00000100:00100000:3.0:1788664365.343556:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664365.343589:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222234624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664365.343673:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664365.343882:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222234624 00000100:00100000:1.0:1788664365.343891:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222234624 00000100:00100000:1.0:1788664365.343954:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788664365.343966:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222234624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664365.344002:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664365.344063:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222234624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664365.344088:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788664365.344224:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222234624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664365.458324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.458461:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204405504 00000100:00100000:0.0:1788664365.458478:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204405504 00000100:00100000:0.0:1788664365.458525:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 163 00000100:00100000:0.0:1788664365.458533:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+51:11502:x1875550204405504:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664365.458559:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664365.458578:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439ab expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664365.458814:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788664365.458925:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ab expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.459010:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:0.0:1788664365.459013:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664365.459019:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ab expref: 53 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.459035:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee200, rc 0) 00000100:00100000:0.0:1788664365.459186:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11502:x1875550204405504:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 652us (872us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788664365.459194:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 163 00000100:00100000:2.0:1788664365.468310:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664365.468586:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204405632 00000100:00100000:3.0:1788664365.468652:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204405632 00000100:00100000:3.0:1788664365.469805:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 164 00000100:00100000:3.0:1788664365.469829:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11502:x1875550204405632:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788664365.469950:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.469968:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.469981:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.469996:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470004:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470011:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470106:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470115:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470123:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664365.470170:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470195:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470213:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470220:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470227:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664365.470232:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470239:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470252:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:3.0:1788664365.470255:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664365.470260:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470266:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90cbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470282:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470289:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470303:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470309:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664365.470318:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470325:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470334:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68c3811100) 00010000:00010000:3.0:1788664365.470337:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664365.470370:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470378:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90cc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470395:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470400:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470406:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470411:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664365.470414:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470419:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470427:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:3.0:1788664365.470429:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664365.470440:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.470446:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90ccc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664365.471050:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11502:x1875550204405632:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 1224us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664365.471061:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 164 00000100:00100000:2.0:1788664365.473988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664365.474182:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204405888 00000100:00100000:3.0:1788664365.474203:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204405888 00000100:00100000:3.0:1788664365.474259:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:3.0:1788664365.474281:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11502:x1875550204405888:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664365.474797:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+53:11502:x1875550204405888:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 527us (817us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788664365.474805:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:2.0:1788664365.559561:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664365.559659:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204406144 00000100:00100000:1.0:1788664365.559669:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204406144 00000100:00100000:1.0:1788664365.559731:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 165 00000100:00100000:1.0:1788664365.559742:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+53:11505:x1875550204406144:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664365.559769:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664365.559790:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90cd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439b2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.559874:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.559889:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.559900:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.559925:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.559934:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.559941:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560059:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560069:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560090:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664365.560104:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788664365.560205:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560213:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560220:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560226:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664365.560231:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560238:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560251:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:1.0:1788664365.560254:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664365.560259:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560265:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560281:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560297:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560308:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560314:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664365.560317:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560323:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560332:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68dc969d00) 00010000:00010000:1.0:1788664365.560334:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664365.560337:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560396:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ce1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560442:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90cd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439b2 expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560456:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439b2 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.560463:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664365.560465:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664365.560468:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2400, rc 0) 00000100:00100000:1.0:1788664365.560969:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11505:x1875550204406144:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1228us (1417us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788664365.560987:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 165 00000100:00100000:2.0:1788664365.567731:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.567809:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204406272 00000100:00100000:0.0:1788664365.567818:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204406272 00000100:00100000:0.0:1788664365.567870:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:0.0:1788664365.567878:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11505:x1875550204406272:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:0.0:1788664365.567957:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.567973:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.567983:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.568009:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.568017:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.568042:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.568048:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664365.568053:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.568061:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.568073:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:0.0:1788664365.568077:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664365.568081:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.568091:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664365.568165:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11505:x1875550204406272:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 286us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664365.568170:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:2.0:1788664365.570322:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664365.570585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204406400 00000100:00100000:3.0:1788664365.570593:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204406400 00000100:00100000:3.0:1788664365.570651:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:3.0:1788664365.570658:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+55:2358:x1875550204406400:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664365.570669:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664365.570687:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ce8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439b2 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664365.570700:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:3.0:1788664365.570703:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664365.570743:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+54:2358:x1875550204406400:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664365.570756:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:1.0:1788664365.571278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664365.571450:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204406656 00000100:00100000:3.0:1788664365.571454:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204406656 00000100:00100000:3.0:1788664365.571488:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:3.0:1788664365.571496:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+54:11505:x1875550204406656:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664365.571710:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11505:x1875550204406656:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 215us (434us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788664365.571715:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00010000:00010000:2.0:1788664365.855508:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664365.863578:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664365.864976:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204406912 00000100:00100000:1.0:1788664365.864988:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204406912 00000100:00100000:1.0:1788664365.865069:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:1.0:1788664365.865149:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11523:x1875550204406912:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:1.0:1788664365.865173:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664365.865194:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90cfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439b9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.865359:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.865373:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.865383:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664365.865955:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788664365.866077:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90cfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439b9 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.866096:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439b9 expref: 57 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.866103:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664365.866105:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788664365.866113:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3800, rc 0) 00000100:00100000:1.0:1788664365.866191:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11523:x1875550204406912:12345-192.168.202.14@tcp:101:cat.0 Request processed in 1046us (2799us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788664365.866197:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 167 00000100:00100000:1.0:1788664365.934128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.934248:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204407040 00000100:00100000:0.0:1788664365.934260:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204407040 00000100:00100000:0.0:1788664365.934324:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:0.0:1788664365.934336:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11524:x1875550204407040:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664365.934393:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664365.934425:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90d12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439c0 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.934527:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.934543:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.935213:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664365.935272:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788664365.935276:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664365.935301:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.935331:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90d12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c0 expref: 59 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.935375:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c0 expref: 58 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.935385:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664365.935388:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664365.935391:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef800, rc 0) 00000100:00100000:0.0:1788664365.935779:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11524:x1875550204407040:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1444us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664365.935788:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 168 00000100:00100000:3.0:1788664365.962155:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664365.962284:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204407424 00000100:00100000:1.0:1788664365.962294:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204407424 00000100:00100000:1.0:1788664365.962385:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788664365.962395:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11524:x1875550204407424:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788664365.962767:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11524:x1875550204407424:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 372us (631us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788664365.962775:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:2.0:1788664365.965771:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664365.966392:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204407552 00000100:00100000:1.0:1788664365.966402:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204407552 00000100:00100000:1.0:1788664365.966592:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:1.0:1788664365.966603:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11524:x1875550204407552:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:1.0:1788664365.966629:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788664365.966656:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439a4 expref: 59 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.966681:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439b9 expref: 58 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.966694:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243965 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664365.966705:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664365.966731:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664365.966820:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+56:11524:x1875550204407552:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 218us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664365.966828:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:2.0:1788664365.979326:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664365.985871:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204407680 00000100:00100000:0.0:1788664365.985887:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204407680 00000100:00100000:0.0:1788664365.985973:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:0.0:1788664365.985985:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+56:11524:x1875550204407680:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:0.0:1788664365.986536:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.986553:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664365.986566:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664365.987290:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788664365.987580:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+56:11524:x1875550204407680:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 1594us (8264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664365.987590:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 169 00000100:00100000:0.0:1788664366.058840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.059507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204407808 00000100:00100000:3.0:1788664366.059519:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204407808 00000100:00100000:3.0:1788664366.059594:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:3.0:1788664366.059605:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+56:11526:x1875550204407808:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664366.059635:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664366.059656:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439c7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059735:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059750:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059764:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059780:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059815:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059823:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059922:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059932:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.059939:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664366.059981:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788664366.059987:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664366.060009:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060023:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060032:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060038:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060045:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060062:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664366.060066:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060073:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060088:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:3.0:1788664366.060091:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664366.060096:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060103:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90d2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060119:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060126:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060132:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060137:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664366.060139:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060146:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060168:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68c3811100) 00010000:00010000:3.0:1788664366.060170:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664366.060174:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060180:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90d35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060228:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060243:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.060250:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:3.0:1788664366.060252:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664366.060255:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a200, rc 0) 00000100:00100000:3.0:1788664366.060321:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11526:x1875550204407808:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 719us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664366.060330:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 170 00000040:00080000:2.0:1788664366.240848:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664366.240859:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664366.240901:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788664366.240921:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664366.241055:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f3d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222234752:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664366.241178:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d1432300 going to sleep for 11 seconds 00000100:00100000:1.0:1788664366.250829:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f3d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222234752:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664366.255385:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.255537:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204407936 00000100:00100000:3.0:1788664366.255548:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204407936 00000100:00100000:3.0:1788664366.255603:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:3.0:1788664366.255614:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11537:x1875550204407936:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788664366.255650:0:5855:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788664366.255775:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11537:x1875550204407936:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 162us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664366.255800:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:3.0:1788664366.282789:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.284099:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204408064 00000100:00100000:0.0:1788664366.284115:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204408064 00000100:00100000:0.0:1788664366.284194:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 172 00000100:00100000:0.0:1788664366.284205:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11537:x1875550204408064:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788664366.284293:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284314:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284327:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284372:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284394:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284402:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284434:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284442:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284449:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664366.284508:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788664366.284514:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664366.284528:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284540:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284548:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284555:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284561:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664366.284565:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284579:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284594:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:0.0:1788664366.284597:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664366.284603:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284610:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90d43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284625:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284632:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284637:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284643:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664366.284646:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284651:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284658:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b68e1346f00) 00010000:00010000:0.0:1788664366.284660:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664366.284663:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284679:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90d4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284696:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284702:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284708:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284713:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664366.284715:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284721:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284730:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:0.0:1788664366.284732:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664366.284735:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.284740:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee600/0x762f55027be90d51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664366.284838:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11537:x1875550204408064:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 635us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664366.284847:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 172 00000100:00100000:2.0:1788664366.288399:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.288797:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204408320 00000100:00100000:3.0:1788664366.288808:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204408320 00000100:00100000:3.0:1788664366.288880:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:3.0:1788664366.288891:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11537:x1875550204408320:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664366.288916:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664366.288936:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90d58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439ce expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289050:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289065:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289087:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664366.289101:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788664366.289221:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289229:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289235:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289241:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664366.289259:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289266:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289279:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:3.0:1788664366.289283:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664366.289288:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289294:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289377:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90d58 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ce expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289390:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:3.0:1788664366.289393:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664366.289397:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90d58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ce expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.289408:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147a600, rc 0) 00000100:00100000:3.0:1788664366.289489:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11537:x1875550204408320:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 588us (1088us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788664366.289498:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 173 00000100:00100000:0.0:1788664366.307294:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664366.308630:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204408448 00000100:00100000:1.0:1788664366.308644:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204408448 00000100:00100000:1.0:1788664366.308717:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00100000:1.0:1788664366.308727:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11537:x1875550204408448:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664366.308764:0:5854:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664366.308873:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11537:x1875550204408448:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 147us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664366.308881:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 174 00000100:00100000:2.0:1788664366.316023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.317038:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204408704 00000100:00100000:0.0:1788664366.317051:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204408704 00000100:00100000:0.0:1788664366.317125:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:0.0:1788664366.317135:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11537:x1875550204408704:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664366.317167:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664366.317170:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788664366.317211:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c0 expref: 58 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.317234:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664366.317251:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664366.317264:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90d6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439d5 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664366.318461:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788664366.318696:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.318712:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.318722:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.318788:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90d6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439d5 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.318807:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439d5 expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.318826:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68dc969d00) 00010000:00010000:1.0:1788664366.318829:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788664366.318832:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2000, rc 0) 00000100:00100000:1.0:1788664366.318908:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11537:x1875550204408704:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 1773us (2895us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788664366.318916:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:2.0:1788664366.338855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.355874:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204408960 00000100:00100000:3.0:1788664366.355890:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204408960 00000100:00100000:2.0:1788664366.357250:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:2.0:1788664366.357264:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11537:x1875550204408960:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664366.357371:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664366.357401:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439d5 expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664366.357422:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68dc969d00) 00010000:00010000:2.0:1788664366.357445:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664366.357483:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664366.357799:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664366.357823:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365013:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365038:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365052:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365143:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365161:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365198:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365205:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664366.365210:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365218:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365232:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664366.365235:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664366.365254:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365261:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90d82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365279:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365286:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365292:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365297:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664366.365300:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365318:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365338:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3732903d (ffff9b68e1346f00) 00010000:00010000:0.0:1788664366.365370:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664366.365373:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.365380:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90d89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3732903d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664366.365728:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11537:x1875550204408960:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 8462us (26879us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788664366.365738:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:0.0:1788664366.371990:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.375820:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204409088 00000100:00100000:3.0:1788664366.375841:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204409088 00000100:00100000:3.0:1788664366.375912:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:3.0:1788664366.375923:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11537:x1875550204409088:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664366.375947:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664366.375973:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90d90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439dc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.376016:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.376033:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.376045:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.376167:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.376196:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.376206:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:3.0:1788664366.376209:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664366.376213:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c147b000, rc 0) 00000100:00100000:3.0:1788664366.376292:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11537:x1875550204409088:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 371us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664366.376300:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 177 00000100:00100000:2.0:1788664366.395059:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.395880:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204409344 00000100:00100000:3.0:1788664366.395894:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204409344 00000100:00100000:3.0:1788664366.395980:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 178 00000100:00100000:3.0:1788664366.395991:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11537:x1875550204409344:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664366.396096:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.396118:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.396132:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788664366.396966:0:7653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788664366.396979:0:7653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400380637065ns, next at 401380634053ns, rc = 0 00000004:00010000:3.0:1788664366.397131:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c9cbd17 reply state 000000007a833d76 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664366.397142:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664366.400670:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11537:x1875550204409344:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 4668us (5609us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788664366.400684:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 178 00000100:00100000:1.0:1788664366.421736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664366.421767:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204409472 00000100:00100000:1.0:1788664366.421776:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204409472 00000100:00100000:1.0:1788664366.421831:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 179 00000100:00100000:1.0:1788664366.421840:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11537:x1875550204409472:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664366.421865:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664366.421884:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439e3 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.421945:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.421959:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.421977:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:1.0:1788664366.421980:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788664366.421984:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3200, rc 0) 00000100:00100000:1.0:1788664366.422037:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11537:x1875550204409472:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 197us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664366.422052:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 179 00010000:00010000:3.0:1788664366.424543:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.424561:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.424570:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.424576:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664366.424582:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.424606:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.424623:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:3.0:1788664366.424625:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788664366.424630:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.424636:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90d9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664366.426475:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664366.426625:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204409600 00000100:00100000:1.0:1788664366.426634:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204409600 00000100:00100000:1.0:1788664366.426699:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:1.0:1788664366.426709:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204409600:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788664366.429001:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204409600:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 2285us (2537us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788664366.429013:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00080000:1.0:1788664366.429050:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664366.440229:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.441727:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204409856 00000100:00100000:0.0:1788664366.441741:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204409856 00000100:00100000:0.0:1788664366.441806:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788664366.441817:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11537:x1875550204409856:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788664366.442071:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11537:x1875550204409856:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 255us (1850us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788664366.442080:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:3.0:1788664366.468023:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.468070:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204410112 00000100:00100000:3.0:1788664366.468081:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204410112 00000100:00100000:3.0:1788664366.468148:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 180 00000100:00100000:3.0:1788664366.468169:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11537:x1875550204410112:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788664366.468623:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11537:x1875550204410112:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 465us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664366.468632:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 180 00000100:00100000:2.0:1788664366.476701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.478291:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204410240 00000100:00100000:3.0:1788664366.478309:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204410240 00000100:00100000:3.0:1788664366.478416:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 181 00000100:00100000:3.0:1788664366.478433:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11537:x1875550204410240:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664366.478472:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664366.478644:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439ea expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.478750:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.478764:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.478777:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664366.480610:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664366.480645:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.480688:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ea expref: 64 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.480706:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ea expref: 63 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.480715:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:3.0:1788664366.480718:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788664366.480721:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479a00, rc 0) 00000100:00100000:3.0:1788664366.485968:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+63:11537:x1875550204410240:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 7526us (9265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664366.485983:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 181 00000100:00100000:0.0:1788664366.513300:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.513367:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204410368 00000100:00100000:0.0:1788664366.513378:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204410368 00000100:00100000:0.0:1788664366.513444:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:0.0:1788664366.513455:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204410368:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664366.513494:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664366.513515:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439f1 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664366.513543:0:8476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cda2f, blocks: 0x1 00010000:00010000:0.0:1788664366.513562:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:0.0:1788664366.513567:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664366.513576:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 8 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.513595:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 8 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.513609:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee600, rc 0) 00000100:00100000:0.0:1788664366.513667:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204410368:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 213us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664366.513674:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:0.0:1788664366.545186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.545357:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.545401:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.545434:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204410624 00000100:00100000:0.0:1788664366.546380:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204410624 00000100:00100000:0.0:1788664366.546644:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:0.0:1788664366.546658:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204410624:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664366.546735:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204410624:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 80us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664366.546759:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:0.0:1788664366.546788:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204410496 00000100:00100000:0.0:1788664366.546793:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204410496 00000100:00100000:0.0:1788664366.546819:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 300 00000100:00100000:0.0:1788664366.546826:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204410496:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664366.546853:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204410496:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664366.546859:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 300 00000100:00080000:0.0:1788664366.546885:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664366.554244:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664366.554283:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204410752 00000100:00100000:2.0:1788664366.554293:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204410752 00000100:00100000:2.0:1788664366.554379:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204411008 00000100:00100000:2.0:1788664366.554383:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204411008 00000100:00100000:2.0:1788664366.555221:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:2.0:1788664366.555235:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204410752:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664366.555324:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204410752:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 93us (9934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664366.555332:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 166 00000100:00100000:2.0:1788664366.555377:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 182 00000100:00100000:2.0:1788664366.555384:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+63:11537:x1875550204411008:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788664366.555684:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+63:11537:x1875550204411008:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 300us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664366.555692:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 182 00000100:00080000:0.0:1788664366.556667:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788664366.557973:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1788664366.558028:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788664366.558611:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788664366.558623:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c3ff8a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788664366.558628:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68d4243200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c3ff8900 00000020:00080000:0.0:1788664366.558631:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68d4243f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c5e3b800 00000020:00080000:2.0:1788664366.560460:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1788664366.562203:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222234880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788664366.562286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664366.563520:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222234880 00000100:00100000:1.0:1788664366.563532:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222234880 00000100:00100000:1.0:1788664366.563591:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788664366.563601:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222234880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788664366.563633:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788664366.563668:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cda2a, atime: 0x6a9cda2b, ctime: 0x6a9cda2a, blocks: 0x1 00010000:00010000:1.0:1788664366.563677:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.563693:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1788664366.563697:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664366.563704:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.563719:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.563748:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.563756:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664366.563770:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788664366.564370:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875550222234880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 768us (2083us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788664366.564379:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000020:00080000:2.0:1788664366.565154:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788664366.565367:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664366.565377:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.565399:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664366.565405:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.565432:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.565453:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.565460:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be90dc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.567162:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664366.567168:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664366.567171:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788664366.567189:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788664366.567242:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68f80ddf80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788664366.567255:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f80ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222234880:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788664366.569124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.569317:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204411136 00000100:00100000:0.0:1788664366.569327:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204411136 00000100:00100000:0.0:1788664366.569428:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:0.0:1788664366.569858:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+8:11537:x1875550204411136:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664366.569881:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664366.569908:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439f8 expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.569953:0:12075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 9 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.569983:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664366.569988:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664366.569994:0:12075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 9 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.571722:0:12075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 9 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.571746:0:12075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 9 pid: 8476 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664366.571764:0:12075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12075:1875550222235008:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664366.572257:0:12075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58eb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788664366.580751:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.580838:0:12075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12075:1875550222235008:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664366.580871:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 9 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664366.580894:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664366.580959:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+9:11537:x1875550204411136:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 11522us (11844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664366.580968:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:3.0:1788664366.581725:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204411264 00000100:00100000:3.0:1788664366.581735:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204411264 00010000:00010000:3.0:1788664366.581772:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 9 pid: 8476 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664366.581831:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:3.0:1788664366.581841:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5892850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204411264:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664366.581859:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664366.581886:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 9 pid: 8476 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.581901:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 9 pid: 8476 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.581927:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90dba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f1 expref: 9 pid: 8476 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.581942:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664366.581946:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664366.581954:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.581965:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664366.582000:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664366.582024:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5841:1875550222235136:192.168.202.14@tcp:105: 00000100:00100000:3.0:1788664366.582112:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664366.593716:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5841:1875550222235136:192.168.202.14@tcp:105: 00010000:00010000:3.0:1788664366.593743:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664366.593799:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5892850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204411264:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 11958us (13060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664366.593811:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:1.0:1788664366.597221:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664366.597754:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204411392 00000100:00100000:3.0:1788664366.597764:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204411392 00002000:00100000:3.0:1788664366.597820:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b68f80dfb80 x1875550204411392/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:672/0 lens 504/0 e 0 to 0 dl 1788664377 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664366.597833:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f80dfb80 with x1875550204411392 ext(0->8) 00002000:00010000:3.0:1788664366.597838:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68f80dfb80 00000100:00100000:3.0:1788664366.597875:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788664366.597885:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204411392:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788664366.602927:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+10:2360:x1875550204411392:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 5032us (5707us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788664366.602942:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00002000:00100000:0.0:1788664366.602966:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b68f80dfb80 x1875550204411392/t4294967314(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:672/0 lens 504/448 e 0 to 0 dl 1788664377 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788664366.602976:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f80dfb80 with x1875550204411392 ext(0->8) 00002000:00010000:0.0:1788664366.602982:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68f80dfb80 00000100:00100000:2.0:1788664366.612857:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664366.613596:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204411520 00000100:00100000:1.0:1788664366.613609:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204411520 00000100:00100000:1.0:1788664366.613686:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 183 00000100:00100000:1.0:1788664366.613696:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11537:x1875550204411520:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788664366.822133:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11537:x1875550204411520:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 208426us (209278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664366.822148:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 183 00000001:00080000:0.0:1788664366.822467:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1788664366.822479:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1788664366.822495:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1788664366.822648:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222235264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788664366.822703:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664366.822788:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222235264 00000100:00100000:0.0:1788664366.822796:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222235264 00000100:00100000:0.0:1788664366.822844:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788664366.822853:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222235264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788664366.823010:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788664366.823013:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788664367 00002000:00010000:0.0:1788664366.823016:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788664366.823018:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788664367 -> 1788664367 00002000:00010000:0.0:1788664366.823020:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788664366.823057:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222235264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 205us (353us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788664366.823064:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788664366.823083:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788664366.823127:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68c6197800/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788664366.823132:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222235264:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1788664366.823869:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788664366.823886:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788664366.827934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664366.828217:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204411648 00000100:00100000:0.0:1788664366.828230:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204411648 00000100:00100000:0.0:1788664366.828310:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:0.0:1788664366.828331:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+10:2360:x1875550204411648:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788664366.893061:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788664366.958325:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1788664366.958382:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1788664366.958420:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1788664366.960282:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204411648:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 131940us (132352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664366.960296:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:1.0:1788664367.033788:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664367.035031:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204411904 00000100:00100000:3.0:1788664367.035046:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204411904 00000100:00100000:3.0:1788664367.035141:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 184 00000100:00100000:3.0:1788664367.035153:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+18:11537:x1875550204411904:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788664367.035219:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664367.035265:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90db3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ea expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.035294:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:3.0:1788664367.035300:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664367.035363:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.035399:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.035417:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788664367.035919:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788664367.036315:0:5856:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000811f630c reply state 00000000c61df30f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664367.036329:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664367.036921:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11537:x1875550204411904:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 1766us (3141us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788664367.036931:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 184 00000100:00100000:0.0:1788664367.066010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:1.0:1788664367.067195:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664367.067212:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664367.067219:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664367.067245:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664367.067251:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664367.067260:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664367.067280:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:1.0:1788664367.067283:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664367.067289:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664367.067295:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90dcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664367.067551:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204412032 00000100:00100000:3.0:1788664367.067562:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204412032 00000100:00100000:3.0:1788664367.067623:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:3.0:1788664367.067635:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dffa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204412032:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788664367.067904:0:12075:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788664367.067908:0:12075:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788664367 -> 1788664366 00002000:00010000:3.0:1788664367.067911:0:12075:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788664363 00002000:00010000:3.0:1788664367.067913:0:12075:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788664367 -> 1788664366 00002000:00010000:3.0:1788664367.067915:0:12075:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788664367.067975:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dffa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2359:x1875550204412032:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 342us (1978us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788664367.067984:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:1.0:1788664367.075594:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664367.075917:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204412288 00000100:00100000:3.0:1788664367.075930:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204412288 00000100:00100000:3.0:1788664367.076059:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 185 00000100:00100000:3.0:1788664367.076070:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+18:11537:x1875550204412288:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788664367.076170:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.076189:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.076199:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.076235:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.076249:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 18 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664367.076264:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222235392:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664367.076388:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c5e93a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664367.100036:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5855:1875550222235392:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664367.100061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:0.0:1788664367.100083:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.100396:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204412416 00000100:00100000:0.0:1788664367.100402:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204412416 00010000:00010000:0.0:1788664367.100437:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 19 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.100481:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:0.0:1788664367.100488:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2361:x1875550204412416:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664367.100500:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664367.100506:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 19 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100516:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 19 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100538:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90d97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439dc expref: 19 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100573:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:0.0:1788664367.100578:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100587:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100596:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100621:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664367.100673:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+18:2361:x1875550204412416:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 184us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664367.100681:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 68 00010000:00010000:0.0:1788664367.100702:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100707:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100734:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100741:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100747:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100753:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664367.100764:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100773:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100781:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:0.0:1788664367.100784:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788664367.100788:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.100795:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90dd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.100840:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+17:11537:x1875550204412288:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 24772us (25255us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788664367.100850:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 185 00000100:00100000:0.0:1788664367.115894:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664367.116089:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204412544 00000100:00100000:2.0:1788664367.116101:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204412544 00000100:00100000:2.0:1788664367.116174:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:2.0:1788664367.116188:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204412544:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788664367.116242:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.116264:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.116273:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788664367.116278:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664367.116283:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.116338:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.116384:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 8 pid: 12075 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664367.116414:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875550222235520:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664367.116525:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2dcfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664367.129266:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664367.129300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204412672 00000100:00100000:2.0:1788664367.129309:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204412672 00010000:00010000:2.0:1788664367.129368:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 9 pid: 12075 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664367.129414:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:2.0:1788664367.129424:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204412672:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664367.129442:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664367.129469:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 9 pid: 12075 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.129483:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 9 pid: 12075 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.129520:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664367.129539:0:5842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664367.129546:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.129558:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.129581:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664367.129630:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204412672:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 206us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664367.129637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00010000:00010000:0.0:1788664367.129893:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4cc39b1/0x762f55027be90dc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439f8 expref: 8 pid: 12075 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.129912:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875550222235520:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664367.129934:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.129946:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.129954:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.129988:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.129996:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.130004:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.130011:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eac00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664367.130016:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.130025:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.130048:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.130057:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be90ddd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.130114:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204412544:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 13929us (14234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664367.130122:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:0.0:1788664367.139630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664367.139706:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204412928 00000100:00100000:2.0:1788664367.139720:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204412928 00000100:00100000:2.0:1788664367.139788:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 186 00000100:00100000:2.0:1788664367.139800:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+17:11537:x1875550204412928:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788664367.139900:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.139929:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.139942:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.140184:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.140196:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.140234:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.140277:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.140291:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 18 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664367.140307:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222235648:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664367.140710:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788664367.151073:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664367.152268:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204413056 00000100:00100000:0.0:1788664367.152281:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204413056 00010000:00010000:0.0:1788664367.152328:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 19 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.152783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:0.0:1788664367.152798:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2360:x1875550204413056:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664367.152819:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664367.152827:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 19 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.152844:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 19 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.152869:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:0.0:1788664367.152875:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.152886:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.152894:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.152915:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664367.153908:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2360:x1875550204413056:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 1106us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664367.153919:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 70 00010000:00010000:0.0:1788664367.158679:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90da5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439e3 expref: 18 pid: 5856 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.158705:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222235648:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664367.158729:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.158739:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.158744:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664367.158951:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788664367.160924:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788664367.161004:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788664367.161117:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1875550222235776:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788664367.161185:0:7653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664367.161226:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c93313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664367.161255:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222235776 00000100:00100000:0.0:1788664367.161262:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222235776 00000100:00100000:0.0:1788664367.161305:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664367.161314:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7653:x1875550222235776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788664367.161424:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7653:x1875550222235776:12345-0@lo:1000:mdt00_003.0 Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664367.161432:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664367.161469:0:7653:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788664367.161475:0:7653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68c6197800, transno 4294967315 00000100:00100000:0.0:1788664367.161488:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1875550222235776:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788664367.161938:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788664367.161986:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1875550222235904:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788664367.162015:0:7653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664367.162032:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664367.162225:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222235904 00000100:00100000:0.0:1788664367.162231:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222235904 00000100:00100000:0.0:1788664367.162256:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664367.162263:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7653:x1875550222235904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788664367.162427:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7653:x1875550222235904:12345-0@lo:1000:mdt00_003.0 Request processed in 163us (410us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788664367.162435:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664367.162468:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1875550222235904:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788664367.162498:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162508:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162516:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162522:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eba00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664367.162527:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162535:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162552:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68c3811100) 00010000:00010000:0.0:1788664367.162562:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664367.162568:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162575:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90deb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162607:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162614:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162619:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162624:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664367.162627:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162632:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162641:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:0.0:1788664367.162643:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664367.162646:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162651:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90d20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162671:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162695:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162704:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162728:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.162742:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 21 pid: 5854 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664367.162753:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8b68000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222236032:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664367.162812:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664367.171458:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8b68000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222236032:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664367.171495:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664367.182309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664367.182352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204413184 00000100:00100000:3.0:1788664367.182371:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204413184 00010000:00010000:3.0:1788664367.182474:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 22 pid: 5854 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664367.182567:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 71 00000100:00100000:3.0:1788664367.182577:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+22:2361:x1875550204413184:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664367.182592:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664367.182604:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 22 pid: 5854 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182619:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 22 pid: 5854 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182641:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439c7 expref: 22 pid: 5854 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182657:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:3.0:1788664367.182663:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182674:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182683:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182713:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664367.182773:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+21:2361:x1875550204413184:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 198us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664367.182781:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 71 00010000:00010000:3.0:1788664367.182810:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182819:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182831:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182843:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182850:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182856:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664367.182860:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182867:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182875:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:3.0:1788664367.182878:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664367.182882:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182888:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90df2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182898:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182904:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182909:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182914:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664367.182921:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182928:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182934:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:3.0:1788664367.182936:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664367.182939:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.182944:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664367.183170:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11537:x1875550204412928:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 43372us (43550us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788664367.183179:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 186 00000020:00080000:3.0:1788664367.183182:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788664367.183290:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664367.183295:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664367.186133:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788664367.186151:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664367.201689:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664367.202164:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204413440 00000100:00100000:0.0:1788664367.202175:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204413440 00000100:00100000:0.0:1788664367.202310:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:0.0:1788664367.202322:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11537:x1875550204413440:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788664367.204515:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788664367.204635:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788664367.204703:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.204722:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.204734:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.204750:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.204757:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.204763:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664367.204786:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788664367.204900:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7ebbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+22:11537:x1875550204413440:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 2577us (3226us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788664367.204910:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000020:00080000:0.0:1788664367.204915:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788664367.205240:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664367.205251:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.205260:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664367.205264:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.205273:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.205301:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b68e1346f00) 00010000:00010000:3.0:1788664367.205304:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788664367.205311:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.205318:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90df9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664367.205367:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664367.205369:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664367.205371:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664367.708738:0:12521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664367.708749:0:12521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664367.708952:0:12521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788664367.708958:0:12521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788664367.909193:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664367.931499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664367.931676:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204413696 00000100:00100000:2.0:1788664367.931688:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204413696 00000100:00100000:2.0:1788664367.931786:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 187 00000100:00100000:2.0:1788664367.931798:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+22:11547:x1875550204413696:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664367.931826:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664367.931850:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd2439ff expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.931977:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90e07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.931994:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.932018:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664367.932030:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788664367.932181:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ff expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.932210:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ff expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.932219:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664367.932222:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664367.932225:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eac00, rc 0) 00000100:00100000:2.0:1788664367.932288:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11547:x1875550204413696:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 493us (802us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788664367.932296:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 187 00000100:00100000:1.0:1788664367.943548:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664367.944003:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204413824 00000100:00100000:2.0:1788664367.944016:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204413824 00000100:00100000:2.0:1788664367.944082:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 188 00000100:00100000:2.0:1788664367.944094:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11547:x1875550204413824:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:2.0:1788664367.944578:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944600:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944614:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944644:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944653:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944661:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944900:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944908:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.944914:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664367.946512:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946540:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946547:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946554:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946561:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eba00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664367.946566:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946585:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946600:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664367.946603:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664367.946608:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946614:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be90e15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946626:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946632:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946638:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946642:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664367.946644:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946649:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946656:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68e9aff600) 00010000:00010000:2.0:1788664367.946659:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664367.946661:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946675:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946693:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946698:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946704:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946709:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eaa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664367.946711:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946717:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946724:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68e9afff00) 00010000:00010000:2.0:1788664367.946726:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664367.946728:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664367.946734:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664367.946847:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11547:x1875550204413824:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 2750us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664367.946857:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 188 00000001:00080000:0.0:1788664368.006329:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788664368.008088:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788664368.008097:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1788664368.046535:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.046615:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204414080 00000100:00100000:1.0:1788664368.046623:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204414080 00000100:00100000:1.0:1788664368.046673:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 189 00000100:00100000:1.0:1788664368.046680:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11550:x1875550204414080:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664368.046698:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664368.046731:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a06 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.046812:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.046829:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.046844:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.046861:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.046869:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.046874:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051036:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051059:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051071:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664368.051099:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788664368.051333:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051364:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051370:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051374:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664368.051390:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051395:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051405:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:3.0:1788664368.051407:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664368.051410:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051415:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be90e31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051424:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051428:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051431:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051434:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664368.051436:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051439:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051442:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68dc969400) 00010000:00010000:3.0:1788664368.051444:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664368.051449:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051452:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be90e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051499:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3c00/0x762f55027be90e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 27 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051508:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 26 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.051513:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:3.0:1788664368.051514:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664368.051516:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479400, rc 0) 00000100:00100000:3.0:1788664368.051569:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+26:11550:x1875550204414080:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 4889us (5042us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788664368.051576:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 189 00000100:00100000:2.0:1788664368.061282:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.061391:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204414208 00000100:00100000:1.0:1788664368.061401:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204414208 00000100:00100000:1.0:1788664368.061460:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 190 00000100:00100000:1.0:1788664368.061471:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+26:11550:x1875550204414208:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:1.0:1788664368.061541:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061561:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061574:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061619:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061627:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061635:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061642:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2e00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.061647:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061654:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061666:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:1.0:1788664368.061670:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664368.061675:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.061682:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be90e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.061758:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+26:11550:x1875550204414208:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 288us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664368.061766:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 190 00000100:00100000:1.0:1788664368.067583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664368.067658:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204414464 00000100:00100000:2.0:1788664368.067671:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204414464 00000100:00100000:2.0:1788664368.067729:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:2.0:1788664368.067740:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+26:11550:x1875550204414464:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664368.068005:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+27:11550:x1875550204414464:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 265us (434us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788664368.068014:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788664368.140518:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664368.140644:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204414720 00000100:00100000:2.0:1788664368.140655:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204414720 00000100:00100000:2.0:1788664368.140718:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 191 00000100:00100000:2.0:1788664368.140729:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+27:11083:x1875550204414720:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788664368.140755:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664368.140787:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a0d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.140954:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.140970:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.140980:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.141019:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.141055:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 28 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664368.141071:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222236160:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664368.141194:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664368.165572:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664368.166034:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222236160:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664368.166066:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.166387:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204414848 00000100:00100000:1.0:1788664368.166396:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204414848 00010000:00010000:1.0:1788664368.166453:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 29 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.166503:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:1.0:1788664368.166514:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+29:2360:x1875550204414848:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664368.166531:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664368.166538:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 29 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.166550:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 29 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.166573:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a06 expref: 29 pid: 5855 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.166593:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:1.0:1788664368.166598:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.166608:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.166615:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.166648:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664368.166702:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+28:2360:x1875550204414848:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 190us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664368.166710:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 72 00010000:00010000:2.0:1788664368.167163:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.167172:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664368.167193:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788664368.167390:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be90e54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.167410:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.167419:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:2.0:1788664368.167423:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664368.167426:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb000, rc 0) 00000100:00100000:2.0:1788664368.167465:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+28:11083:x1875550204414720:12345-192.168.202.14@tcp:101:bash.0 Request processed in 26739us (26959us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788664368.167483:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 191 00000100:00100000:0.0:1788664368.178256:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.178325:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204415104 00000100:00100000:1.0:1788664368.178363:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204415104 00000100:00100000:1.0:1788664368.178417:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 192 00000100:00100000:1.0:1788664368.178424:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+28:11083:x1875550204415104:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:1.0:1788664368.178691:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.178710:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.178723:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664368.178780:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788664368.178805:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2808004 reply state 00000000ecde96a6 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.178812:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788664368.178847:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788664368.178947:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11083:x1875550204415104:12345-192.168.202.14@tcp:36:bash.0 Request processed in 521us (702us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788664368.178956:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 192 00000020:00080000:1.0:1788664368.178965:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788664368.182982:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.183002:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.183009:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.183015:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3e00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664368.183019:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.183040:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.183058:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:3.0:1788664368.183061:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664368.183066:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.183072:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3e00/0x762f55027be90e69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664368.185908:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664368.186011:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204415232 00000100:00100000:3.0:1788664368.186020:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204415232 00000100:00100000:3.0:1788664368.186101:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:3.0:1788664368.186112:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+31:11083:x1875550204415232:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:3.0:1788664368.186141:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664368.186167:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a14 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.186235:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a14 expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.186250:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a14 expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.186272:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:3.0:1788664368.186275:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664368.186279:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c1479a00, rc 0) 00000100:00100000:3.0:1788664368.186387:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11083:x1875550204415232:12345-192.168.202.14@tcp:101:bash.0 Request processed in 276us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664368.186394:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 193 00000100:00100000:1.0:1788664368.195981:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664368.196106:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204415360 00000100:00100000:0.0:1788664368.196117:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204415360 00000100:00100000:0.0:1788664368.196206:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788664368.196219:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:11083:x1875550204415360:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664368.196255:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664368.196279:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a1b expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664368.196312:0:8476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cda2e, atime: 0x6a9cda2b, ctime: 0x6a9cda2e, blocks: 0xb 00000100:00080000:2.0:1788664368.196656:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788664368.196704:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1788664368.196711:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664368.196721:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 8 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.196743:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 8 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.196757:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee600, rc 0) 00000100:00100000:0.0:1788664368.196826:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+8:11083:x1875550204415360:12345-192.168.202.14@tcp:101:bash.0 Request processed in 609us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664368.196833:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788664368.202000:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.202116:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204415488 00000100:00100000:1.0:1788664368.202126:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204415488 00002000:00010000:1.0:1788664368.202178:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788664368.202183:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8b6ad80 with x1875550204415488 ext(0->18446744073709551615) 00002000:00010000:1.0:1788664368.202197:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68f8b6ad80. 00000100:00100000:1.0:1788664368.202234:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:1.0:1788664368.202258:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204415488:12345-192.168.202.14@tcp:10:bash.0 00002000:00010000:1.0:1788664368.202824:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788664368.202829:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788664366 -> 1788664369 00002000:00010000:1.0:1788664368.202832:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788664363 -> 1788664363 00002000:00010000:1.0:1788664368.202835:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788664366 -> 1788664369 00002000:00010000:1.0:1788664368.202837:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788664368.203035:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2361:x1875550204415488:12345-192.168.202.14@tcp:10:bash.0 Request processed in 777us (1044us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788664368.203045:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00002000:00010000:1.0:1788664368.203049:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788664368.203051:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68f8b6ad80 with x1875550204415488 ext(0->18446744073709551615) 00002000:00010000:1.0:1788664368.203057:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68f8b6ad80. 00000040:00080000:3.0:1788664368.227927:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788664368.227940:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788664368.227980:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788664368.227987:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664368.329563:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.330388:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204415616 00000100:00100000:1.0:1788664368.330404:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204415616 00000100:00100000:1.0:1788664368.330492:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 194 00000100:00100000:1.0:1788664368.330505:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11563:x1875550204415616:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:1.0:1788664368.330598:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330617:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330629:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330643:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330668:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330675:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330939:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330949:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.330956:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664368.331009:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331023:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331031:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331038:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331046:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.331068:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331077:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331096:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:1.0:1788664368.331099:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664368.331104:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331112:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331127:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331134:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331140:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331146:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.331149:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331155:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331163:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68dc969c00) 00010000:00010000:1.0:1788664368.331166:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664368.331168:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331175:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90e85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331202:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331209:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.331215:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.332504:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.332517:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.332529:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.332542:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:1.0:1788664368.332546:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664368.332550:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.332558:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.332694:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11563:x1875550204415616:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 2185us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664368.332706:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 194 00000100:00100000:2.0:1788664368.413656:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664368.413719:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204415872 00000100:00100000:3.0:1788664368.413730:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204415872 00000100:00100000:3.0:1788664368.413959:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 195 00000100:00100000:3.0:1788664368.413971:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11567:x1875550204415872:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664368.413994:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664368.414018:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90e93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a22 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.414177:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.414193:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.414205:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.414221:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.414228:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664368.414234:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415568:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90ea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415584:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415596:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664368.415609:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788664368.415724:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415733:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415740:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415746:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664368.415750:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415758:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415969:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664368.415974:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664368.415979:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.415986:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479400/0x762f55027be90e9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416004:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416011:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416017:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416022:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664368.416031:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416107:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416117:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68c3811200) 00010000:00010000:0.0:1788664368.416120:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664368.416123:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416129:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416185:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478200/0x762f55027be90e93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a22 expref: 35 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416201:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a22 expref: 34 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.416208:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:0.0:1788664368.416211:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788664368.416213:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efa00, rc 0) 00000100:00100000:0.0:1788664368.416288:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11567:x1875550204415872:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 2319us (2645us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788664368.416297:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 195 00000100:00100000:3.0:1788664368.416683:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664368.416699:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222236288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664368.416746:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664368.416825:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222236288 00000100:00100000:0.0:1788664368.416831:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222236288 00000100:00100000:0.0:1788664368.416870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788664368.416878:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222236288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664368.416926:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664368.416955:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875550222236288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664368.416960:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788664368.416973:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664368.417592:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222236288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664368.422971:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664368.423129:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204416000 00000100:00100000:2.0:1788664368.423139:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204416000 00000100:00100000:2.0:1788664368.428094:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 196 00000100:00100000:2.0:1788664368.428119:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11567:x1875550204416000:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788664368.428203:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.428221:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.428228:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.428256:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.428267:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 34 pid: 5854 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664368.428277:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222236416:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664368.428403:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff8840 going to sleep for 11 seconds 00000100:00100000:2.0:1788664368.436022:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664368.436327:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f3f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222236416:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664368.436385:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664368.436690:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204416256 00000100:00100000:3.0:1788664368.436698:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204416256 00000100:00100000:3.0:1788664368.436754:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:3.0:1788664368.436764:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+35:5600:x1875550204416256:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788664368.439855:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+36:5600:x1875550204416256:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 3081us (3831us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788664368.439868:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:3.0:1788664368.448704:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664368.448770:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204416384 00000100:00100000:0.0:1788664368.448778:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204416384 00010000:00010000:0.0:1788664368.448812:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 36 pid: 5854 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664368.448844:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:0.0:1788664368.448850:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+36:2360:x1875550204416384:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664368.448863:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664368.448870:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 36 pid: 5854 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.448891:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 36 pid: 5854 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.448933:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb000/0x762f55027be90e5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a0d expref: 36 pid: 5854 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.448947:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:0.0:1788664368.448950:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.448957:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.448962:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.448987:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664368.449030:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+35:2360:x1875550204416384:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 180us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664368.449035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 73 00010000:00010000:1.0:1788664368.449171:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449177:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449217:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449222:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449226:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449230:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.449233:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449237:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449243:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:1.0:1788664368.449245:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664368.449248:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.449252:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.449292:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11567:x1875550204416000:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 21186us (26334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664368.449297:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 196 00000100:00100000:3.0:1788664368.451834:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664368.451909:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204416640 00000100:00100000:0.0:1788664368.451919:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204416640 00000100:00100000:0.0:1788664368.451975:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:0.0:1788664368.451982:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+34:11567:x1875550204416640:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:0.0:1788664368.452220:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+35:11567:x1875550204416640:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 238us (393us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788664368.452225:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:0.0:1788664368.611254:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664368.611467:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204416896 00000100:00100000:2.0:1788664368.611486:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204416896 00000100:00100000:2.0:1788664368.611539:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 197 00000100:00100000:2.0:1788664368.611547:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+35:11578:x1875550204416896:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:2.0:1788664368.611568:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664368.611585:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90ebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a29 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611676:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611691:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611703:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611717:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611723:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611727:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611978:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611988:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.611994:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664368.612008:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788664368.615522:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615536:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615541:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615546:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664368.615550:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615555:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615568:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664368.615570:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664368.615574:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615578:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be90ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615589:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615593:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615614:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.615619:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664368.615622:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.616121:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.616128:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68e9afff00) 00010000:00010000:2.0:1788664368.616130:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664368.616132:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.616136:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be90ecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.616404:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be90ebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a29 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.616416:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a29 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.616421:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:2.0:1788664368.616422:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664368.616424:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb600, rc 0) 00000100:00100000:2.0:1788664368.616763:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+37:11578:x1875550204416896:12345-192.168.202.14@tcp:101:cat.0 Request processed in 5216us (5528us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788664368.616780:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 197 00000100:00100000:0.0:1788664368.624797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.624967:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204417152 00000100:00100000:1.0:1788664368.624977:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204417152 00000100:00100000:1.0:1788664368.625042:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:1.0:1788664368.625078:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+37:11578:x1875550204417152:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:1.0:1788664368.625369:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+38:11578:x1875550204417152:12345-192.168.202.14@tcp:35:cat.0 Request processed in 272us (551us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788664368.625378:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 54 00000100:00100000:3.0:1788664368.717183:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.717307:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204417408 00000100:00100000:1.0:1788664368.717317:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204417408 00000100:00100000:1.0:1788664368.717409:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 198 00000100:00100000:1.0:1788664368.717420:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+38:11579:x1875550204417408:12345-192.168.202.14@tcp:36:rm.0 00010000:00010000:1.0:1788664368.717487:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788664368.717515:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb600/0x762f55027be90ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a29 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717540:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be90ea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a22 expref: 37 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717553:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1479a00/0x762f55027be90e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a14 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717581:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68c3811300) 00010000:00010000:1.0:1788664368.717592:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664368.717615:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717628:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717637:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717668:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717677:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717683:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717955:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717964:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.717971:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664368.718584:0:7653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788664368.718596:0:7653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402702253614ns, next at 403702250842ns, rc = 0 00010000:00010000:1.0:1788664368.718673:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.718684:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.718692:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.718700:0:7653:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.718716:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.718723:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720231:0:7653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664368.720276:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720286:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720293:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720298:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.720303:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720311:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720326:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68dc969a00) 00010000:00010000:1.0:1788664368.720329:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788664368.720334:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720359:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be90eee lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720385:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720404:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720409:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720414:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.720417:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720423:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720432:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:1.0:1788664368.720435:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664368.720438:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.720443:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90ee0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664368.720454:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002c08505 reply state 000000000d662fca transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.720463:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664368.722154:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+37:11579:x1875550204417408:12345-192.168.202.14@tcp:36:rm.0 Request processed in 4715us (4961us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788664368.722165:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 198 00010000:00010000:2.0:1788664368.726283:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664368.726297:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.726308:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664368.726312:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.726322:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.726367:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b68dc969a00) 00010000:00010000:2.0:1788664368.726371:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664368.726376:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.726383:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be90ef5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664368.726410:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664368.726412:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664368.726414:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664368.739227:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.739265:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.739273:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.739279:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664368.739284:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.739291:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.739310:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68dc969c00) 00010000:00010000:1.0:1788664368.739313:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664368.739317:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.739324:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90ee7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664368.846057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664368.846212:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204417664 00000100:00100000:0.0:1788664368.846237:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204417664 00000100:00100000:0.0:1788664368.846306:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 199 00000100:00100000:0.0:1788664368.846316:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+36:11585:x1875550204417664:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664368.846381:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664368.846404:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90efc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a30 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.846524:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.846538:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.846561:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.846576:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.846583:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.846589:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664368.847122:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788664368.847288:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847297:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847315:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847384:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847392:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847400:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847406:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664368.847411:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847418:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847433:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664368.847436:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664368.847441:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847447:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664368.847461:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029935b44 reply state 000000006105bf5a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664368.847469:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788664368.847505:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90efc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847521:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 38 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.847527:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:0.0:1788664368.847529:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664368.847532:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef400, rc 0) 00000100:00100000:0.0:1788664368.847606:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ceed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+39:11585:x1875550204417664:12345-192.168.202.14@tcp:101:bash.0 Request processed in 1291us (1567us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788664368.847614:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 199 00010000:00010000:0.0:1788664368.851248:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.851268:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.851277:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.851283:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664368.851288:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.851297:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.851316:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664368.851319:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664368.851959:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.851969:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664368.867961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664368.868079:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204417792 00000100:00100000:0.0:1788664368.868092:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204417792 00000100:00100000:0.0:1788664368.868189:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:0.0:1788664368.868203:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204417792:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664368.868224:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664368.868248:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a37 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664368.868285:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788664368.868315:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1788664368.868320:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664368.868331:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.868394:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.868410:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efa00, rc 0) 00000100:00100000:0.0:1788664368.868467:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2359:x1875550204417792:12345-192.168.202.14@tcp:101:bash.0 Request processed in 269us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664368.868474:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00080000:2.0:1788664368.869236:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664368.873895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664368.874125:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204417920 00000100:00100000:0.0:1788664368.874146:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204417920 00000100:00100000:0.0:1788664368.874207:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:0.0:1788664368.874218:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+6:11585:x1875550204417920:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664368.874237:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664368.874254:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a3e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.874287:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.874296:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664368.874301:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664368.874307:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.874357:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.874372:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 7 pid: 6697 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664368.874386:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875550222236544:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664368.874473:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331540 going to sleep for 11 seconds 00000100:00100000:0.0:1788664368.887963:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6696:1875550222236544:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664368.888010:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664368.888062:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664368.888123:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+7:11585:x1875550204417920:12345-192.168.202.14@tcp:101:bash.0 Request processed in 13906us (14239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664368.888132:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:2.0:1788664368.905696:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.905967:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204418048 00000100:00100000:1.0:1788664368.905988:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204418048 00010000:00010000:1.0:1788664368.906047:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 7 pid: 6697 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.906096:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:1.0:1788664368.906107:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5890050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204418048:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664368.906128:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664368.906171:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 7 pid: 6697 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.906186:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 7 pid: 6697 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.906212:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7130daf/0x762f55027be90f1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a37 expref: 7 pid: 6697 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.906230:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664368.906235:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664368.906243:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.906254:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664368.906297:0:7644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664368.906313:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7644:1875550222236672:192.168.202.14@tcp:105: 00000100:00100000:1.0:1788664368.906464:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eeae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788664368.910293:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7644:1875550222236672:192.168.202.14@tcp:105: 00010000:00010000:1.0:1788664368.910321:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664368.910408:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5890050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2361:x1875550204418048:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 4302us (4721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664368.910433:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:3.0:1788664368.919027:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664368.919196:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204418304 00000100:00100000:1.0:1788664368.919208:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204418304 00000100:00100000:1.0:1788664368.919267:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 55 00000100:00100000:1.0:1788664368.919277:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+38:11585:x1875550204418304:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:1.0:1788664368.919693:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+39:11585:x1875550204418304:12345-192.168.202.14@tcp:35:bash.0 Request processed in 417us (675us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788664368.919701:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 55 00010000:00010000:3.0:1788664368.931200:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664369.210996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.211130:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204418432 00000100:00100000:0.0:1788664369.211141:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204418432 00000100:00100000:0.0:1788664369.211256:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 200 00000100:00100000:0.0:1788664369.211267:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+39:11601:x1875550204418432:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664369.211294:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.211314:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a45 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.211414:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.211429:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.211444:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664369.211493:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788664369.211499:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664369.211519:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.211545:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a45 expref: 41 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.211599:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a45 expref: 40 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.211617:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664369.211621:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664369.211625:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef600, rc 0) 00000100:00100000:0.0:1788664369.212114:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+40:11601:x1875550204418432:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 847us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.212122:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 200 00000100:00080000:2.0:1788664369.215990:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664369.217331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.217474:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204418688 00000100:00100000:0.0:1788664369.217485:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204418688 00000100:00100000:0.0:1788664369.217550:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:0.0:1788664369.217561:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+40:11601:x1875550204418688:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664369.217583:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.217604:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90f3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a4c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.217740:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90f42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.217755:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.217782:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664369.217797:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788664369.217970:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be90f3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a4c expref: 43 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.217990:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a4c expref: 42 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.218000:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:0.0:1788664369.218003:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664369.218006:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef800, rc 0) 00000100:00100000:0.0:1788664369.218076:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+42:11601:x1875550204418688:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 517us (755us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788664369.218084:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 201 00000100:00100000:3.0:1788664369.222178:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664369.222277:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204418944 00000100:00100000:1.0:1788664369.222286:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204418944 00000100:00100000:1.0:1788664369.222380:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 202 00000100:00100000:1.0:1788664369.222392:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+42:11601:x1875550204418944:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664369.222421:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664369.222444:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90f50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a53 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.222548:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90f57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.222562:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.222573:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90f57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664369.222587:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788664369.222743:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be90f50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a53 expref: 45 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.222794:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90f57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a53 expref: 44 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.222804:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:1.0:1788664369.222808:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788664369.222811:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2400, rc 0) 00000100:00100000:1.0:1788664369.222883:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+44:11601:x1875550204418944:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 493us (715us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788664369.222892:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 202 00000100:00100000:3.0:1788664369.226867:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.227027:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204419072 00000100:00100000:0.0:1788664369.227037:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204419072 00000100:00100000:0.0:1788664369.227104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788664369.227116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+44:2361:x1875550204419072:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664369.227133:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664369.227161:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a4c expref: 44 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.227184:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:0.0:1788664369.227190:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664369.227258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+43:2361:x1875550204419072:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 145us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.227266:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:3.0:1788664369.236260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.236393:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204419200 00000100:00100000:0.0:1788664369.236406:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204419200 00000100:00100000:0.0:1788664369.236503:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:0.0:1788664369.236514:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+6:2358:x1875550204419200:12345-192.168.202.14@tcp:1:lfs.0 00010000:00010000:0.0:1788664369.236566:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.236587:0:8476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.236595:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788664369.236599:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664369.236604:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.236644:0:8476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 6 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.236658:0:8476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 6 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664369.236685:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8476:1875550222236800:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664369.236790:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664369.243047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664369.243238:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204419328 00000100:00100000:2.0:1788664369.243248:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204419328 00002000:00100000:2.0:1788664369.243318:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b68c3e06a00 x1875550204419328/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:675/0 lens 504/0 e 0 to 0 dl 1788664380 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664369.243330:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c3e06a00 with x1875550204419328 ext(0->8) 00010000:00010000:2.0:1788664369.243389:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 7 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.243409:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 7 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664369.243417:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68c3e06a00 00000100:00100000:2.0:1788664369.243441:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:2.0:1788664369.243453:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204419328:12345-192.168.202.14@tcp:4:lfs.0 00000100:00100000:2.0:1788664369.244304:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204419328:12345-192.168.202.14@tcp:4:lfs.0 Request processed in 848us (1262us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788664369.244314:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00002000:00100000:2.0:1788664369.244322:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b68c3e06a00 x1875550204419328/t4294967308(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:675/0 lens 504/448 e 0 to 0 dl 1788664380 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788664369.244331:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68c3e06a00 with x1875550204419328 ext(0->8) 00010000:00010000:2.0:1788664369.244377:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 9 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.244392:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 9 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664369.244399:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9b68c3e06a00 00000100:00100000:0.0:1788664369.244965:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9020700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8476:1875550222236800:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664369.244991:0:8476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664369.251075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.251189:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204419456 00000100:00100000:0.0:1788664369.251216:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204419456 00010000:00010000:0.0:1788664369.251260:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 9 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664369.251307:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 75 00000100:00100000:0.0:1788664369.251317:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204419456:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664369.251335:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788664369.252058:0:5840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788664369.252063:0:5840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788664369 00002000:00010000:0.0:1788664369.252065:0:5840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788664370 00002000:00010000:0.0:1788664369.252067:0:5840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788664369 00010000:00010000:0.0:1788664369.252075:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 9 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.252091:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 9 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.252116:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4cc39b1/0x762f55027be90f26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a3e expref: 9 pid: 6696 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.252135:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664369.252139:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664369.252146:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.252155:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.252201:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664369.252253:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204419456:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 937us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.252262:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 75 00010000:00010000:2.0:1788664369.252322:0:8476:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252332:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252432:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252442:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252451:0:8476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252458:0:8476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664369.252462:0:8476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252548:0:8476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252562:0:8476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664369.252571:0:8476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc507332/0x762f55027be90f65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664369.253455:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204419200:12345-192.168.202.14@tcp:1:lfs.0 Request processed in 16940us (17204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664369.253465:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:3.0:1788664369.256243:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664369.256314:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204419712 00000100:00100000:1.0:1788664369.256323:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204419712 00000100:00100000:1.0:1788664369.256406:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 56 00000100:00100000:1.0:1788664369.256416:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+43:11601:x1875550204419712:12345-192.168.202.14@tcp:35:lfs.0 00000004:00010000:1.0:1788664369.256502:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90f57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a53 expref: 43 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664369.256816:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788664369.256866:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788664369.257205:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788664369.257261:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.257277:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 47 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.257285:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.257359:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 47 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.257377:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 47 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664369.257392:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5857:1875550222236928:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664369.258256:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664369.261452:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.261544:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204419840 00000100:00100000:0.0:1788664369.261553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204419840 00010000:00010000:0.0:1788664369.261592:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 48 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664369.261644:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:0.0:1788664369.261655:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+48:2360:x1875550204419840:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664369.261682:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664369.261689:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 48 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.261705:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 48 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.261727:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:0.0:1788664369.261733:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.261743:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.261750:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.261797:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664369.261846:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+48:2360:x1875550204419840:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 192us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.261854:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00010000:00010000:1.0:1788664369.265494:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a30 expref: 47 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664369.265522:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5857:1875550222236928:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664369.265547:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.265557:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.265563:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788664369.265949:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788664369.266163:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788664369.266268:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222237056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664369.266755:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664369.266795:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788664369.266871:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222237056 00000100:00100000:0.0:1788664369.266880:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222237056 00000100:00080000:2.0:1788664369.266990:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664369.267061:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664369.267072:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222237056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788664369.267162:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222237056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.267170:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664369.267264:0:5857:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788664369.267278:0:5857:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788664369.267296:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68f80ddf80, transno 4294967307 00000100:00100000:1.0:1788664369.267318:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222237056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788664369.268301:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788664369.268833:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222237184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788664369.268891:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664369.269022:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9cd9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664369.269258:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222237184 00000100:00100000:0.0:1788664369.269265:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222237184 00000100:00100000:0.0:1788664369.269361:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664369.269373:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1875550222237184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788664369.269567:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1875550222237184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 197us (675us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788664369.269575:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664369.269657:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5857:1875550222237184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788664369.269726:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788664369.269779:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.269791:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.269799:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.269806:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664369.269810:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.269818:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.269835:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:1.0:1788664369.269838:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788664369.269843:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.269865:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2000/0x762f55027be90f6c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788664369.270061:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788664369.270162:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788664369.270174:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403253832329ns, next at 404253830394ns, rc = 0 00000001:00080000:1.0:1788664369.270181:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788664369.270212:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:1.0:1788664369.270215:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788664369.270222:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be90f57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a53 expref: 51 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664369.270328:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+50:11601:x1875550204419712:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 13913us (14096us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788664369.270337:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 56 00000020:00080000:1.0:1788664369.270358:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788664369.277413:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.277577:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204419968 00000100:00100000:0.0:1788664369.277588:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204419968 00000100:00100000:0.0:1788664369.277653:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:0.0:1788664369.277669:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+50:11601:x1875550204419968:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664369.277694:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.277715:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a5a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.277806:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a5a expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.277822:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a5a expref: 51 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.277843:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.277846:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664369.277850:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664369.277928:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+51:11601:x1875550204419968:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 266us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.277936:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 203 00000100:00100000:3.0:1788664369.282085:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664369.282266:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204420224 00000100:00100000:2.0:1788664369.282279:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204420224 00000100:00100000:2.0:1788664369.282382:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:2.0:1788664369.282394:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+51:11601:x1875550204420224:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664369.282682:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11601:x1875550204420224:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 290us (608us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788664369.282689:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 57 00000100:00100000:1.0:1788664369.402975:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664369.403786:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204420352 00000100:00100000:3.0:1788664369.403811:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204420352 00000100:00100000:3.0:1788664369.403877:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 204 00000100:00100000:3.0:1788664369.403887:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11611:x1875550204420352:12345-192.168.202.14@tcp:34:lfs.0 00010000:00010000:3.0:1788664369.403978:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.403995:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404007:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404021:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404028:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404035:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404122:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404129:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404136:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664369.404183:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404207:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404213:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404219:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404225:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664369.404229:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404236:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404248:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:3.0:1788664369.404251:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664369.404261:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404268:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90f7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404281:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404287:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404293:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404303:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664369.404306:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404312:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404332:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68c3811200) 00010000:00010000:3.0:1788664369.404335:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664369.404338:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404392:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90f81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404409:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404415:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404420:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404426:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664369.404428:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404434:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404453:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664369.404455:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664369.404459:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.404465:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664369.404561:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f80dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11611:x1875550204420352:12345-192.168.202.14@tcp:34:lfs.0 Request processed in 674us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664369.404570:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 204 00000100:00100000:3.0:1788664369.489486:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.489767:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204420608 00000100:00100000:0.0:1788664369.489780:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204420608 00000100:00100000:0.0:1788664369.489838:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:0.0:1788664369.489850:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+52:11614:x1875550204420608:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664369.489873:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.489905:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a61 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.489997:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490012:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490024:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490054:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490062:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490068:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490193:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90fa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490202:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490209:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664369.490221:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788664369.490318:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490326:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490332:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490372:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664369.490377:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490406:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490418:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664369.490422:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664369.490426:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490433:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90f96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490446:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490453:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490459:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490465:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664369.490468:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490475:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490482:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68e1346100) 00010000:00010000:0.0:1788664369.490484:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664369.490487:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490505:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490547:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90f8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a61 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490562:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90fa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a61 expref: 54 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.490580:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.490582:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664369.490584:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef800, rc 0) 00000100:00100000:0.0:1788664369.491208:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+54:11614:x1875550204420608:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1357us (1738us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788664369.491216:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 205 00000100:00100000:1.0:1788664369.515677:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664369.516207:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204420736 00000100:00100000:3.0:1788664369.516217:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204420736 00000100:00100000:3.0:1788664369.516278:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 206 00000100:00100000:3.0:1788664369.516289:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+54:11614:x1875550204420736:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:3.0:1788664369.516417:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516435:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516446:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516474:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516481:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516499:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516505:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664369.516510:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516517:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516528:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664369.516531:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664369.516535:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.516541:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664369.516632:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+54:11614:x1875550204420736:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 336us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664369.516640:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 206 00000100:00100000:1.0:1788664369.532246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664369.532428:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204420992 00000100:00100000:2.0:1788664369.532439:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204420992 00000100:00100000:2.0:1788664369.532498:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:2.0:1788664369.532509:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+54:11614:x1875550204420992:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664369.532806:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11614:x1875550204420992:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 298us (569us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788664369.532815:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 58 00000100:00100000:2.0:1788664369.672011:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.672175:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204421248 00000100:00100000:0.0:1788664369.672186:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204421248 00000100:00100000:0.0:1788664369.672254:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:0.0:1788664369.672265:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11624:x1875550204421248:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664369.672293:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.672296:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788664369.672322:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a45 expref: 55 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.672380:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664369.672395:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664369.672424:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90fb9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a68 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.672553:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90fc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.672567:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.672578:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664369.672589:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788664369.673062:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90fb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a68 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.673080:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a68 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.673089:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.673092:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664369.673094:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef400, rc 0) 00000100:00100000:0.0:1788664369.673163:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+56:11624:x1875550204421248:12345-192.168.202.14@tcp:101:bash.0 Request processed in 901us (1162us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788664369.673171:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 207 00000100:00100000:3.0:1788664369.678689:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664369.678871:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204421376 00000100:00100000:1.0:1788664369.678883:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204421376 00000100:00100000:1.0:1788664369.678953:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:1.0:1788664369.678965:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+56:2358:x1875550204421376:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664369.678984:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664369.679010:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be90fc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a68 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.679054:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:1.0:1788664369.679060:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664369.679123:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+55:2358:x1875550204421376:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 160us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664369.679132:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:1.0:1788664369.685979:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664369.686172:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204421632 00000100:00100000:3.0:1788664369.686184:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204421632 00000100:00100000:3.0:1788664369.686283:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 208 00000100:00100000:3.0:1788664369.686294:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+55:11624:x1875550204421632:12345-192.168.202.14@tcp:36:bash.0 00010000:00010000:3.0:1788664369.689254:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664369.689310:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be90fa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a61 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.689390:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664369.689398:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664369.690238:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.690258:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.690268:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664369.690330:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788664369.691334:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9c75692 reply state 000000005f5eb957 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664369.692216:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788664369.693533:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11624:x1875550204421632:12345-192.168.202.14@tcp:36:bash.0 Request processed in 7233us (7555us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788664369.693544:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 208 00000020:00080000:3.0:1788664369.693551:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788664369.701230:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.701254:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.701261:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.701268:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664369.701273:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.701281:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.701309:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:1.0:1788664369.701313:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664369.701318:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664369.701325:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664369.705049:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.705149:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204421760 00000100:00100000:0.0:1788664369.705162:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204421760 00000100:00100000:0.0:1788664369.705228:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 209 00000100:00100000:0.0:1788664369.705241:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+56:11624:x1875550204421760:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664369.705291:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.705316:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90fd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a6f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.705467:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.705483:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.705494:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664369.705527:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788664369.705534:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664369.705557:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.705588:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90fd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.705606:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.705615:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.705619:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664369.705623:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef600, rc 0) 00000100:00100000:0.0:1788664369.705695:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11624:x1875550204421760:12345-192.168.202.14@tcp:101:bash.0 Request processed in 458us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.705703:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 209 00000100:00100000:2.0:1788664369.719895:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.720012:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204422016 00000100:00100000:0.0:1788664369.720023:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204422016 00000100:00100000:0.0:1788664369.720091:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:0.0:1788664369.720103:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+57:11624:x1875550204422016:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:0.0:1788664369.720418:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11624:x1875550204422016:12345-192.168.202.14@tcp:35:bash.0 Request processed in 317us (533us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788664369.720426:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 59 00000100:00100000:1.0:1788664369.789673:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.790080:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204422144 00000100:00100000:0.0:1788664369.790091:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204422144 00000100:00100000:0.0:1788664369.790204:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 210 00000100:00100000:0.0:1788664369.790216:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+58:11630:x1875550204422144:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664369.790242:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.790264:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90fe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a76 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.790400:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.790417:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.790429:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664369.790470:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788664369.790476:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664369.790496:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.791045:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be90fe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a76 expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.791068:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a76 expref: 59 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.791078:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664369.791081:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664369.791086:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efc00, rc 0) 00000100:00100000:0.0:1788664369.791163:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11630:x1875550204422144:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 949us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.791172:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 210 00000100:00100000:2.0:1788664369.803574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664369.804820:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204422272 00000100:00100000:3.0:1788664369.804835:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204422272 00000100:00100000:3.0:1788664369.805175:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00100000:3.0:1788664369.805187:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11630:x1875550204422272:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664369.805209:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664369.805230:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90ff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a7d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805325:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805401:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805413:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805431:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805438:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805445:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805558:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805567:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805575:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664369.805614:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788664369.805619:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664369.805638:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805659:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805668:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805675:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805683:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805688:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147b000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664369.805702:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805710:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805721:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:3.0:1788664369.805724:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664369.805729:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805735:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b000/0x762f55027be90ff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805749:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805762:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805774:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805779:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c147a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664369.805782:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805790:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805797:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68c3811200) 00010000:00010000:3.0:1788664369.805800:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664369.805802:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805808:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a200/0x762f55027be90fff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805853:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147a600/0x762f55027be90ff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805873:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.805880:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664369.805882:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664369.805885:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2400, rc 0) 00000100:00100000:3.0:1788664369.806563:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11630:x1875550204422272:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1376us (2997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664369.806584:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 211 00000100:00100000:2.0:1788664369.813279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664369.813431:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204422528 00000100:00100000:3.0:1788664369.813443:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204422528 00000100:00100000:3.0:1788664369.813506:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 212 00000100:00100000:3.0:1788664369.813516:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11630:x1875550204422528:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664369.813536:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664369.813557:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b3800/0x762f55027be9100d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a84 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.813738:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.813754:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.813763:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.813770:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.813979:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.813996:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 61 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664369.814010:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222237312:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664369.814171:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.814182:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 61 pid: 5854 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664369.814191:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f35500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222237440:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664369.814214:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664369.823213:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.824447:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204422656 00000100:00100000:0.0:1788664369.824458:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204422656 00010000:00010000:0.0:1788664369.824505:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 62 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664369.824547:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:0.0:1788664369.824557:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+62:2361:x1875550204422656:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664369.824574:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664369.824581:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 62 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.824595:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 62 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.824642:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.824649:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.824659:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.824666:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664369.824738:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+62:2361:x1875550204422656:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 181us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.824748:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:2.0:1788664369.835885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:3.0:1788664369.836796:0:7653:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.14@tcp) returned -22 from blocking AST (req@00000000fe1a6087 x1875550222237312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 61 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.836837:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a7d expref: 61 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664369.836870:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222237312:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664369.836888:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f35500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1875550222237440:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664369.836925:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664369.836933:0:7653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.836943:0:7653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.836954:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664369.838837:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204422784 00000100:00100000:0.0:1788664369.838852:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204422784 00010000:00010000:0.0:1788664369.838905:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 61 pid: 5854 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664369.838951:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:0.0:1788664369.838961:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+61:2361:x1875550204422784:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664369.838978:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664369.838985:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 61 pid: 5854 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.838998:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 61 pid: 5854 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.839021:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be90fdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a6f expref: 61 pid: 5854 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.839056:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.839061:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.839071:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.839079:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.839112:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664369.839228:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+60:2361:x1875550204422784:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 267us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.839235:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00010000:00010000:3.0:1788664369.839712:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664369.839735:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664369.839757:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788664369.841004:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b3800/0x762f55027be9100d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 61 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.841160:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 60 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.841168:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.841170:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788664369.841173:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2600, rc 0) 00000100:00100000:0.0:1788664369.841231:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11630:x1875550204422528:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 27716us (27964us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788664369.842432:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 212 00000100:00100000:2.0:1788664369.843384:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.843473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204423040 00000100:00100000:0.0:1788664369.843493:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204423040 00000100:00100000:0.0:1788664369.843569:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:0.0:1788664369.843576:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5891850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11630:x1875550204423040:12345-192.168.202.14@tcp:103:lfs.0 00010000:00010000:0.0:1788664369.843598:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664369.843619:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be90f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a5a expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.843641:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.843644:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664369.843679:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5891850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11630:x1875550204423040:12345-192.168.202.14@tcp:103:lfs.0 Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.843684:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:1.0:1788664369.850026:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.850121:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204423168 00000100:00100000:0.0:1788664369.850134:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204423168 00000100:00100000:0.0:1788664369.850284:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:0.0:1788664369.850299:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11630:x1875550204423168:12345-192.168.202.14@tcp:58:lfs.0 00010000:00010000:0.0:1788664369.850765:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.850784:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.850797:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664369.851217:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788664369.851739:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11630:x1875550204423168:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 1441us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.851749:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 213 00000100:00100000:1.0:1788664369.854439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664369.854532:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204423296 00000100:00100000:0.0:1788664369.854541:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204423296 00000100:00100000:0.0:1788664369.854597:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:0.0:1788664369.854608:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+59:11630:x1875550204423296:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664369.854629:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664369.854648:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a8b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.854714:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.854725:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.854743:0:5856:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.854757:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.854773:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664369.854775:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664369.854778:0:5856:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 60 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664369.854784:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664369.854839:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11630:x1875550204423296:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 233us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664369.854846:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 214 00000100:00100000:3.0:1788664369.951728:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222237824:0@lo:400:kworker.0 00000100:00100000:3.0:1788664369.951795:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664369.951969:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222237696:0@lo:400:kworker.0 00000100:00100000:1.0:1788664369.951999:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664369.952047:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222237824 00000100:00100000:1.0:1788664369.952054:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222237824 00000100:00100000:1.0:1788664369.952109:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222237696 00000100:00100000:1.0:1788664369.952112:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222237696 00000100:00100000:1.0:1788664369.952131:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788664369.952140:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222237824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664369.952185:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222237824:12345-0@lo:400:kworker.0 Request processed in 46us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664369.952193:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788664369.952209:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788664369.952215:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222237696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664369.952259:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3416d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222237696:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664369.952266:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788664369.952302:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222237952:0@lo:400:kworker.0 00000100:00100000:1.0:1788664369.952329:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664369.952376:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222237952 00000100:00100000:1.0:1788664369.952380:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222237952 00000100:00100000:1.0:1788664369.952404:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788664369.952412:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222237952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664369.952461:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222237952:12345-0@lo:400:kworker.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664369.952467:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788664369.953060:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222237824:0@lo:400:kworker.0 00000100:00100000:2.0:1788664369.953196:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222237568:0@lo:400:kworker.0 00000100:00100000:2.0:1788664369.953253:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788664369.953280:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664369.953446:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222237696:0@lo:400:kworker.0 00000100:00100000:2.0:1788664369.953522:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8cdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222237952:0@lo:400:kworker.0 00010000:00010000:0.0:1788664369.953616:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664369.953719:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222237568 00000100:00100000:3.0:1788664369.953724:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222237568 00000100:00100000:3.0:1788664369.953759:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788664369.953766:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222237568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664369.953803:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3307:x1875550222237568:12345-0@lo:400:kworker.0 Request processed in 37us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664369.953809:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788664369.954380:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222237568:0@lo:400:kworker.0 00000100:00100000:1.0:1788664369.954389:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f88aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222238080:0@lo:400:kworker.0 00000100:00100000:1.0:1788664369.954419:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664369.954510:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222238080 00000100:00100000:2.0:1788664369.954515:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222238080 00000100:00100000:2.0:1788664369.954566:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788664369.954574:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222238080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664369.954614:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222238080:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664369.954621:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788664369.954646:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f88aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222238080:0@lo:400:kworker.0 00000100:00080000:3.0:1788664369.955016:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788664370.271596:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788664370.271604:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788664370.271668:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788664370.271676:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788664370.271798:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12ab800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222238208:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788664370.271905:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664370.276418:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12ab800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222238208:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664370.280956:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.281061:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204423424 00000100:00100000:1.0:1788664370.281070:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204423424 00000100:00100000:1.0:1788664370.281127:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:1.0:1788664370.281138:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11632:x1875550204423424:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664370.281175:0:5855:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664370.281288:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11632:x1875550204423424:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 152us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664370.281294:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 215 00000100:00100000:1.0:1788664370.284413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.284500:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204423552 00000100:00100000:2.0:1788664370.284511:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204423552 00000100:00100000:2.0:1788664370.284571:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:2.0:1788664370.284580:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11632:x1875550204423552:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788664370.284678:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284695:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284708:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284722:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284741:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284747:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284770:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284778:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284784:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664370.284824:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788664370.284830:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664370.284844:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284855:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284861:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284867:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.284872:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664370.285205:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285220:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285233:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:2.0:1788664370.285236:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664370.285241:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285247:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91030 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285260:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285267:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285273:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285279:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664370.285282:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285288:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285294:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b68e9afff00) 00010000:00010000:2.0:1788664370.285297:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664370.285300:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285315:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be91037 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285333:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285339:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285474:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285479:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664370.285482:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285488:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285497:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664370.285499:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664370.285502:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.285507:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be9103e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.285576:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11632:x1875550204423552:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 996us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.285584:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 216 00000100:00100000:2.0:1788664370.297651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664370.297726:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204423808 00000100:00100000:0.0:1788664370.297737:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204423808 00000100:00100000:0.0:1788664370.297799:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:0.0:1788664370.297808:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+60:11632:x1875550204423808:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664370.297828:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664370.297846:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be91045 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a92 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.297959:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.297974:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.297986:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664370.297998:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788664370.298088:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298095:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298100:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298106:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664370.298111:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298130:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298140:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664370.298144:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664370.298148:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298153:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be9104c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298195:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be91045 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a92 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298206:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:0.0:1788664370.298208:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788664370.298212:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be91045 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a92 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.298221:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee200, rc 0) 00000100:00100000:0.0:1788664370.298304:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11632:x1875550204423808:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 489us (655us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788664370.298312:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 217 00000100:00100000:0.0:1788664370.301023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.301116:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204423936 00000100:00100000:1.0:1788664370.301126:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204423936 00000100:00100000:1.0:1788664370.301244:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:1.0:1788664370.301267:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11632:x1875550204423936:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664370.301316:0:7653:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664370.301458:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11632:x1875550204423936:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 193us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664370.301465:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 218 00000100:00100000:3.0:1788664370.303967:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664370.308873:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204424192 00000100:00100000:0.0:1788664370.308888:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204424192 00000100:00100000:0.0:1788664370.308955:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:0.0:1788664370.308966:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11632:x1875550204424192:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664370.309004:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664370.309007:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788664370.309047:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be90fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a76 expref: 61 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.309066:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:0.0:1788664370.309072:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664370.309085:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9105a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243a99 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664370.309694:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788664370.309896:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be91061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.309911:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be91061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.309922:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be91061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.309980:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be9105a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a99 expref: 63 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.309995:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be91061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a99 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.310001:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:0.0:1788664370.310004:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664370.310014:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66efa00, rc 0) 00000100:00100000:0.0:1788664370.311228:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11632:x1875550204424192:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 2258us (7261us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788664370.311239:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 219 00000100:00100000:3.0:1788664370.314670:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.314719:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204424448 00000100:00100000:2.0:1788664370.314728:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204424448 00000100:00100000:2.0:1788664370.314781:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:2.0:1788664370.314788:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11632:x1875550204424448:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664370.314842:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664370.314867:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efa00/0x762f55027be91061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a99 expref: 62 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.314897:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664370.314908:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664370.314930:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.314943:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.314953:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.314969:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.314976:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.314983:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315711:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315740:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315748:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315754:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664370.315758:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315765:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315774:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664370.315776:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664370.315780:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315786:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea600/0x762f55027be9106f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315797:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315803:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315808:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315814:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664370.315823:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315829:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315837:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa094f012 (ffff9b68e9afff00) 00010000:00010000:2.0:1788664370.315839:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664370.315842:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.315848:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb200/0x762f55027be91076 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa094f012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.315946:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11632:x1875550204424448:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 1155us (1283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788664370.315954:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 220 00000100:00100000:2.0:1788664370.319709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.319935:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204424576 00000100:00100000:1.0:1788664370.319946:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204424576 00000100:00100000:1.0:1788664370.319994:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 221 00000100:00100000:1.0:1788664370.320004:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+61:11632:x1875550204424576:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664370.320036:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664370.320059:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9107d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243aa0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.320098:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.320111:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.320134:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.320242:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9107d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 63 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.320261:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 62 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.320281:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:1.0:1788664370.320285:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788664370.320288:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3200, rc 0) 00000100:00100000:1.0:1788664370.320637:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11632:x1875550204424576:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 632us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664370.320645:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 221 00000100:00100000:3.0:1788664370.328568:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.328803:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204424832 00000100:00100000:1.0:1788664370.328813:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204424832 00000100:00100000:1.0:1788664370.328876:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 222 00000100:00100000:1.0:1788664370.328886:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f88aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+62:11632:x1875550204424832:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788664370.328980:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.329000:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.329011:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664370.329259:0:7653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1788664370.329268:0:7653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404312925788ns, next at 405312923398ns, rc = 0 00000004:00010000:1.0:1788664370.329494:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce2c85ef reply state 00000000587fd4ed transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664370.329504:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664370.329602:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f88aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+64:11632:x1875550204424832:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 718us (1045us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788664370.329645:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 222 00010000:00010000:0.0:1788664370.333822:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.333840:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.333848:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.333854:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664370.333859:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.333868:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.333884:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:0.0:1788664370.333887:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664370.333892:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.333899:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be9108b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664370.335825:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.336910:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204424960 00000100:00100000:3.0:1788664370.336922:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204424960 00000100:00100000:3.0:1788664370.337014:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 223 00000100:00100000:3.0:1788664370.337026:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+63:11632:x1875550204424960:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664370.337080:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664370.337103:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243aa7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.337188:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 64 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.337200:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 64 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.337219:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:3.0:1788664370.337222:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664370.337225:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2400, rc 0) 00000100:00100000:3.0:1788664370.337288:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+64:11632:x1875550204424960:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 265us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664370.337295:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 223 00000100:00100000:2.0:1788664370.350988:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664370.351234:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204425088 00000100:00100000:0.0:1788664370.351244:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204425088 00000100:00100000:0.0:1788664370.351327:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:0.0:1788664370.351361:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2361:x1875550204425088:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788664370.351927:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664370.352596:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+10:2361:x1875550204425088:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 1256us (1616us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788664370.352606:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:0.0:1788664370.359595:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.360212:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204425344 00000100:00100000:1.0:1788664370.360222:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204425344 00000100:00100000:1.0:1788664370.360280:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:1.0:1788664370.360289:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+64:11632:x1875550204425344:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788664370.364659:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+65:11632:x1875550204425344:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 4357us (5059us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788664370.364674:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 60 00000100:00100000:0.0:1788664370.375184:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.378845:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204425600 00000100:00100000:1.0:1788664370.378858:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204425600 00000100:00100000:2.0:1788664370.381238:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 224 00000100:00100000:2.0:1788664370.381252:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+65:11632:x1875550204425600:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788664370.381397:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+65:11632:x1875550204425600:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 147us (6629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.381404:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 224 00000100:00100000:2.0:1788664370.387254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664370.387994:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204425728 00000100:00100000:0.0:1788664370.388008:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204425728 00000100:00100000:0.0:1788664370.388129:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 225 00000100:00100000:0.0:1788664370.388140:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+65:11632:x1875550204425728:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664370.388161:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664370.388182:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be91099 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243aae expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.388255:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be910a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.388270:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be910a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.388281:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be910a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664370.388320:0:5856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664370.388372:0:5856:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be910a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.388400:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efc00/0x762f55027be91099 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aae expref: 67 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.388434:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be910a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aae expref: 66 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.388443:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:0.0:1788664370.388446:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788664370.388450:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee200, rc 0) 00000100:00100000:0.0:1788664370.388638:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+66:11632:x1875550204425728:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 500us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664370.388646:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 225 00000100:00100000:0.0:1788664370.392039:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.392666:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204425856 00000100:00100000:2.0:1788664370.392677:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204425856 00000100:00100000:2.0:1788664370.392772:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:2.0:1788664370.392783:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+10:2360:x1875550204425856:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664370.392801:0:8476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664370.392821:0:8476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243ab5 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664370.392849:0:8476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cda33, blocks: 0x1 00010000:00010000:2.0:1788664370.392868:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1788664370.392873:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664370.392883:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 11 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.392902:0:8476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 11 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.392916:0:8476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb600, rc 0) 00000100:00100000:2.0:1788664370.392982:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+11:2360:x1875550204425856:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 200us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.392990:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:0.0:1788664370.398758:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.398910:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204426112 00000100:00100000:1.0:1788664370.398921:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204426112 00000100:00100000:0.0:1788664370.399394:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 226 00000100:00100000:0.0:1788664370.399405:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+66:11632:x1875550204426112:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788664370.399540:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+66:11632:x1875550204426112:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 137us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664370.399548:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 226 00000100:00100000:3.0:1788664370.402000:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.402081:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204426240 00000100:00100000:2.0:1788664370.402090:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204426240 00000100:00100000:2.0:1788664370.402150:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:2.0:1788664370.402160:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+11:11632:x1875550204426240:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664370.402191:0:12075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664370.402209:0:12075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243abc expref: -99 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.402243:0:12075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 12 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.402253:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664370.402257:0:12075:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664370.402263:0:12075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 12 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.402295:0:12075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 12 pid: 8476 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.402308:0:12075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 12 pid: 8476 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.402323:0:12075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12075:1875550222238336:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664370.402681:0:12075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664370.405863:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.405964:0:12075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f8ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12075:1875550222238336:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664370.405996:0:12075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 12 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.406017:0:12075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea600, rc 0) 00000100:00100000:2.0:1788664370.406082:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+12:11632:x1875550204426240:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3923us (4090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.406091:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:0.0:1788664370.406327:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204426368 00000100:00100000:0.0:1788664370.406334:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204426368 00010000:00010000:0.0:1788664370.406404:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 12 pid: 8476 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664370.406436:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:0.0:1788664370.406444:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+12:2361:x1875550204426368:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664370.406457:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664370.406482:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 12 pid: 8476 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.406495:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 12 pid: 8476 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.406518:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be910a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ab5 expref: 12 pid: 8476 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.406532:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664370.406536:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664370.406544:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 11 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.406554:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 11 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.406586:0:7644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 11 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664370.406599:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1bf6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7644:1875550222238464:192.168.202.14@tcp:105: 00000100:00100000:0.0:1788664370.406662:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c9331a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788664370.409680:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1bf6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7644:1875550222238464:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788664370.409704:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664370.409775:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+11:2361:x1875550204426368:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 3329us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664370.409804:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:1.0:1788664370.412031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664370.412099:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204426496 00000100:00100000:0.0:1788664370.412108:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204426496 00002000:00100000:0.0:1788664370.412168:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b67c722ca80 x1875550204426496/t0(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:676/0 lens 504/0 e 0 to 0 dl 1788664381 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788664370.412179:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b67c722ca80 with x1875550204426496 ext(0->12) 00002000:00010000:0.0:1788664370.412184:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b67c722ca80 00000100:00100000:0.0:1788664370.412412:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788664370.412423:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+11:2361:x1875550204426496:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788664370.412916:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2361:x1875550204426496:12345-192.168.202.14@tcp:4:lhsmtool_posix.0 Request processed in 494us (891us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788664370.412924:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00002000:00100000:0.0:1788664370.412932:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9b67c722ca80 x1875550204426496/t4294967320(0) o4->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:676/0 lens 504/448 e 0 to 0 dl 1788664381 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788664370.412940:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b67c722ca80 with x1875550204426496 ext(0->12) 00002000:00010000:0.0:1788664370.412944:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b67c722ca80 00000100:00100000:3.0:1788664370.415555:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.415698:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204426624 00000100:00100000:2.0:1788664370.415707:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204426624 00000100:00100000:2.0:1788664370.415777:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 227 00000100:00100000:2.0:1788664370.415788:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+66:11632:x1875550204426624:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000004:00080000:3.0:1788664370.469907:0:7960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404453561962ns, next at 405453559016ns, rc = 0 00000100:00100000:3.0:1788664370.469927:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664370.469946:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222238592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664370.470010:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664370.470050:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222238592 00000100:00100000:3.0:1788664370.470058:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222238592 00000100:00100000:3.0:1788664370.470097:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788664370.470105:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222238592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664370.470127:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664370.470161:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222238592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664370.470182:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788664370.470225:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222238592:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788664370.492146:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000020:00080000:0.0:1788664370.492190:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c93313c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788664370.492196:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68e48f1500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c9331900 00000020:00080000:0.0:1788664370.492200:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68e48f1e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68fb99a800 00000001:00080000:0.0:1788664370.492228:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788664370.492235:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788664370.492338:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788664370.492391:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c9cd9000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788664370.492395:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68df66fc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c9cd9f00 00000020:00080000:0.0:1788664370.492398:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68df66f000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68fb7c7800 00000004:00080000:0.0:1788664370.492421:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:2.0:1788664370.492591:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+36:11632:x1875550204426624:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 76800us (77039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.492619:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 227 00000020:00080000:3.0:1788664370.492694:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788664370.492895:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788664370.495305:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222238720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788664370.495397:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664370.495433:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664370.495440:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222238848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788664370.495463:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664370.495502:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222238720 00000100:00100000:3.0:1788664370.495509:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222238720 00000100:00100000:3.0:1788664370.495554:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222238848 00000100:00100000:3.0:1788664370.495558:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222238848 00000100:00100000:3.0:1788664370.495575:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788664370.495582:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1875550222238720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788664370.495621:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1788664370.495645:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.495667:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 12 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.495676:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788664370.495680:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664370.495685:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.495734:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 12 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.495749:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 12 pid: 8476 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.495773:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875550222238976:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664370.495828:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d43f0b40 going to sleep for 11 seconds 00000100:00080000:3.0:1788664370.495841:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664370.495855:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788664370.495863:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875550222238848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788664370.496014:0:8476:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788664370.496018:0:8476:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788664371 00002000:00010000:3.0:1788664370.496021:0:8476:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788664370.496023:0:8476:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788664371 -> 1788664371 00002000:00010000:3.0:1788664370.496025:0:8476:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788664370.496065:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1875550222238848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (600us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788664370.496072:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:3.0:1788664370.496110:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b67c722c380/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788664370.496116:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222238848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788664370.496191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.496259:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204426752 00000100:00100000:3.0:1788664370.496263:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204426752 00000100:00100000:3.0:1788664370.496297:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:3.0:1788664370.496303:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+13:2360:x1875550204426752:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788664370.499142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.499179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204426880 00000100:00100000:3.0:1788664370.499188:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204426880 00010000:00010000:3.0:1788664370.499224:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 14 pid: 8476 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.499260:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:3.0:1788664370.499270:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+14:2360:x1875550204426880:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788664370.499285:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664370.499301:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 14 pid: 8476 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.499316:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 14 pid: 8476 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.499364:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664370.499369:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664370.499375:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.499385:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.499404:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664370.499458:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+14:2360:x1875550204426880:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 189us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664370.499466:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00010000:00010000:2.0:1788664370.500985:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000087b06d3/0x762f55027be90e77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a1b expref: 13 pid: 8476 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.501008:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6696:1875550222238976:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664370.501032:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.501043:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.501050:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.501060:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.501083:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.501119:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788664370.501745:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3309:x1875550222238720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6161us (6346us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788664370.501768:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1788664370.502064:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664370.502071:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.502080:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b2000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664370.502084:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.502092:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.502109:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.502116:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.502134:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664370.502136:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664370.502137:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788664370.502166:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b67c722ea00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788664370.502172:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222238720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788664370.505081:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222239104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788664370.505150:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664370.505871:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222239104 00000100:00100000:2.0:1788664370.505880:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222239104 00000100:00100000:2.0:1788664370.505932:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664370.505943:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875550222239104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788664370.505970:0:8476:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788664370.506003:0:8476:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cda31, atime: 0x6a9cda32, ctime: 0x6a9cda31, blocks: 0x1 00010000:00010000:2.0:1788664370.506012:0:8476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.506028:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1788664370.506032:0:8476:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664370.506039:0:8476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.506055:0:8476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.506065:0:8476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.506083:0:8476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.506099:0:8476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664370.506858:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664370.506865:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.506875:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664370.506880:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.506890:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.506908:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.506916:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004c2804c/0x762f55027be910bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.506935:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664370.506937:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664370.506939:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664370.507140:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222239104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1197us (1987us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788664370.507149:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:3.0:1788664370.515033:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68f8f8ca80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788664370.515047:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222239104:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788664370.562830:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1788664370.562854:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788664370.562863:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:2.0:1788664370.563032:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2360:x1875550204426752:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 66722us (66834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.563044:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 70 00000100:00100000:1.0:1788664370.566890:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.566980:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204427136 00000100:00100000:2.0:1788664370.566990:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204427136 00000100:00100000:2.0:1788664370.567082:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 228 00000100:00100000:2.0:1788664370.567094:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11632:x1875550204427136:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788664370.567150:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664370.567179:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee200/0x762f55027be910a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aae expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.567211:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:2.0:1788664370.567218:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664370.567252:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.567266:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.567293:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788664370.567863:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000674420cc reply state 000000004b837dc2 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.567875:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664370.567987:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+21:11632:x1875550204427136:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 894us (1106us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788664370.567995:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 228 00010000:00010000:3.0:1788664370.570462:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.570494:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.570502:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.570522:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664370.570527:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.570535:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.570551:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:3.0:1788664370.570554:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664370.570558:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.570565:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea800/0x762f55027be910c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664370.574905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.575173:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204427264 00000100:00100000:2.0:1788664370.575183:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204427264 00000100:00100000:2.0:1788664370.575242:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:2.0:1788664370.575252:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204427264:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788664370.575735:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788664370.575752:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788664371 -> 1788664370 00002000:00010000:2.0:1788664370.575754:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788664370 00002000:00010000:2.0:1788664370.575757:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788664371 -> 1788664370 00002000:00010000:2.0:1788664370.575759:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788664370.575823:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204427264:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 571us (926us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788664370.575831:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 72 00000100:00100000:1.0:1788664370.578451:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.579202:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204427520 00000100:00100000:3.0:1788664370.579213:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204427520 00000100:00100000:3.0:1788664370.579270:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 229 00000100:00100000:3.0:1788664370.579281:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11632:x1875550204427520:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788664370.579385:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.579403:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.579413:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.579450:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.579491:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 20 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.579508:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222239232:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664370.579609:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68cbb26600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664370.584509:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.584603:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204427648 00000100:00100000:2.0:1788664370.584613:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204427648 00010000:00010000:2.0:1788664370.584654:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 21 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.584715:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:2.0:1788664370.584725:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+21:2361:x1875550204427648:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664370.584750:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664370.584758:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 21 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.584770:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 21 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.584791:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:2.0:1788664370.584797:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.584806:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.584814:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.584832:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664370.584883:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+21:2361:x1875550204427648:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 159us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.584890:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00010000:00010000:3.0:1788664370.585395:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa0 expref: 20 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.585413:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5856:1875550222239232:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664370.585431:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585439:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585445:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585477:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585484:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585490:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585496:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b2a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664370.585510:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585517:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585527:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:3.0:1788664370.585530:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788664370.585534:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.585540:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.585604:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11632:x1875550204427520:12345-192.168.202.14@tcp:55:lhsmtool_posix.0 Request processed in 6324us (7164us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788664370.585612:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 229 00000100:00100000:1.0:1788664370.588825:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.588945:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204427776 00000100:00100000:3.0:1788664370.588955:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204427776 00000100:00100000:3.0:1788664370.589017:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:3.0:1788664370.589028:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204427776:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788664370.589075:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.589096:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.589105:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788664370.589110:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788664370.589129:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.589166:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 8 pid: 12075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.589181:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 8 pid: 12075 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.589270:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875550222239360:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664370.589419:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68cbb26600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664370.594708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.594988:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875550222239360:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664370.595016:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664370.595115:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204427904 00000100:00100000:0.0:1788664370.595123:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204427904 00010000:00010000:2.0:1788664370.595302:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 9 pid: 12075 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.595409:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 82 00000100:00100000:2.0:1788664370.595429:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+9:2360:x1875550204427904:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664370.595460:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664370.595499:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 9 pid: 12075 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.595513:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 9 pid: 12075 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.595537:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce90c68c/0x762f55027be910ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243abc expref: 9 pid: 12075 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.595554:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664370.595558:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788664370.595564:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.595574:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.595615:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664370.595667:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2360:x1875550204427904:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 238us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.595674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 82 00010000:00010000:1.0:1788664370.595728:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595748:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595784:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595792:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595800:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595808:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b2000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664370.595812:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595821:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595833:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.595841:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b1db26c/0x762f55027be910d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664370.595883:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204427776:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 6857us (7067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664370.595890:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 73 00000100:00100000:1.0:1788664370.599095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.599178:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204428160 00000100:00100000:3.0:1788664370.599187:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204428160 00000100:00100000:3.0:1788664370.599259:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 230 00000100:00100000:3.0:1788664370.599270:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11632:x1875550204428160:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788664370.599383:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.599401:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.599412:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.599672:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.599686:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.599695:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.599729:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.599848:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 20 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.599863:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222239488:192.168.202.14@tcp:104: 00000100:00100000:3.0:1788664370.599940:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68cbb26600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664370.603562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.603825:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222239488:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664370.603851:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664370.603945:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204428288 00000100:00100000:0.0:1788664370.603953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204428288 00010000:00010000:1.0:1788664370.604132:0:5842:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 21 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664370.604173:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:1.0:1788664370.604183:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+21:2360:x1875550204428288:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664370.604267:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664370.604275:0:5842:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 21 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.604288:0:5842:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 21 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.604311:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2400/0x762f55027be91092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aa7 expref: 21 pid: 5855 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.604327:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:1.0:1788664370.604333:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.604370:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.604378:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.604397:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664370.604444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+20:2360:x1875550204428288:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 262us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664370.604463:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00010000:00010000:3.0:1788664370.606082:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.606096:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788664370.606394:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788664370.606863:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788664370.606912:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788664370.607001:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1875550222239616:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788664370.607064:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664370.607157:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c12edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664370.607326:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222239616 00000100:00100000:0.0:1788664370.607334:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222239616 00000100:00100000:0.0:1788664370.607714:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664370.607726:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1875550222239616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788664370.607828:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1875550222239616:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664370.607835:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788664370.607893:0:5854:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788664370.607899:0:5854:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1788664370.607917:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b67c722c380, transno 4294967321 00000004:00080000:3.0:1788664370.607932:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b67c722ea00, transno 4294967322 00000100:00100000:3.0:1788664370.607940:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1875550222239616:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788664370.608418:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788664370.608492:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1875550222239744:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788664370.608535:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664370.609196:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c1359f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664370.609285:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222239744 00000100:00100000:2.0:1788664370.609292:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222239744 00000100:00100000:2.0:1788664370.609325:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664370.609332:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5854:x1875550222239744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788664370.609637:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5854:x1875550222239744:12345-0@lo:1000:mdt00_000.0 Request processed in 304us (1100us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788664370.609644:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664370.609727:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5854:1875550222239744:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788664370.609822:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609842:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609850:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609856:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b2800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664370.609860:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609868:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609891:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68dc969c00) 00010000:00010000:3.0:1788664370.609894:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664370.609900:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609907:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be910df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609938:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609944:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609950:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609955:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664370.609958:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609964:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609972:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664370.609975:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664370.609980:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.609990:0:5854:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.610006:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.610034:0:5854:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 23 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.610045:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222239872:192.168.202.14@tcp:105: 00000100:00100000:3.0:1788664370.610143:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664370.615139:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664370.615215:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204428416 00000100:00100000:0.0:1788664370.615224:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204428416 00000100:00100000:0.0:1788664370.615282:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:0.0:1788664370.615292:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11630:x1875550204428416:12345-192.168.202.14@tcp:49:lfs.0 00000100:00100000:0.0:1788664370.615450:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11630:x1875550204428416:12345-192.168.202.14@tcp:49:lfs.0 Request processed in 160us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664370.615458:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 61 00000100:00100000:3.0:1788664370.617977:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c6197480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222239872:192.168.202.14@tcp:105: 00010000:00010000:3.0:1788664370.618010:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.618020:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef600/0x762f55027be91022 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.618378:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.618457:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204428672 00000100:00100000:3.0:1788664370.618465:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204428672 00000100:00100000:3.0:1788664370.618536:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 231 00000100:00100000:3.0:1788664370.618547:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11630:x1875550204428672:12345-192.168.202.14@tcp:58:lfs.0 00000040:00080000:3.0:1788664370.619093:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788664370.619277:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11630:x1875550204428672:12345-192.168.202.14@tcp:58:lfs.0 Request processed in 731us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664370.619288:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 231 00010000:00010000:1.0:1788664370.629420:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.629445:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.629458:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.629487:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.629494:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.629501:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.629506:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664370.629511:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.629519:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630487:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:1.0:1788664370.630491:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664370.630498:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630535:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630553:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630559:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630566:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630571:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b2a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664370.630575:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630703:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630714:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:1.0:1788664370.630716:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788664370.630720:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.630726:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be910d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664370.631022:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+23:11632:x1875550204428160:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 31749us (31931us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788664370.631034:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 230 00000020:00080000:1.0:1788664370.631046:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788664370.631497:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664370.631503:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664370.631554:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788664370.631560:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788664370.631875:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f8ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222240000:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788664370.631941:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3ff8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788664370.652875:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.652905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.652988:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204429056 00000100:00100000:1.0:1788664370.652998:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204429056 00000100:00100000:1.0:1788664370.653077:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 232 00000100:00100000:1.0:1788664370.653087:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11634:x1875550204429056:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664370.653127:0:7653:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664370.653232:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+24:11634:x1875550204429056:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 147us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664370.653240:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 232 00000100:00100000:3.0:1788664370.653785:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f8ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1875550222240000:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664370.654336:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204428928 00000100:00100000:0.0:1788664370.654367:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204428928 00000100:00100000:0.0:1788664370.654404:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 62 00000100:00100000:0.0:1788664370.654413:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+23:11632:x1875550204428928:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788664370.658159:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788664370.658287:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788664370.658391:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.658409:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.658422:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.658433:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.658440:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.658448:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.658488:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664370.659260:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664370.659269:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.659277:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664370.659281:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.659289:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.659302:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b68e1346700) 00010000:00010000:2.0:1788664370.659305:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664370.659309:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.659315:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be910ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.659368:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664370.659371:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664370.659372:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664370.665830:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+25:11632:x1875550204428928:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 11301us (12849us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788664370.665848:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 62 00000020:00080000:1.0:1788664370.665856:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788664370.670634:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664370.670676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.671021:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204429184 00000100:00100000:1.0:1788664370.671031:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204429184 00000100:00100000:1.0:1788664370.671087:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204429440 00000100:00100000:1.0:1788664370.671091:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204429440 00000100:00100000:1.0:1788664370.671123:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 233 00000100:00100000:1.0:1788664370.671133:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+26:11635:x1875550204429184:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:1.0:1788664370.671154:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664370.671175:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243ac3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.671250:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.671264:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.671293:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.671309:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.671317:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.671324:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.671684:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 234 00000100:00100000:3.0:1788664370.671701:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+27:11634:x1875550204429440:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788664370.671710:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664370.671721:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91109 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243aca expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.671806:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.671815:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.671823:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664370.671833:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788664370.671956:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91109 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aca expref: 30 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.671973:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aca expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.671982:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664370.671986:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788664370.671989:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2c00, rc 0) 00000100:00100000:3.0:1788664370.672051:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+29:11634:x1875550204429440:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 352us (1373us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788664370.672058:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 234 00010000:00010000:0.0:1788664370.673069:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.673089:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 28 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.673098:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.673135:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 28 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664370.673151:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 28 pid: 7653 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664370.673175:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1bf6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222240128:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664370.673238:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f85ab0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664370.676897:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1bf6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5854:1875550222240128:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664370.676930:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664370.680273:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664370.680375:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204429952 00000100:00100000:3.0:1788664370.680385:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204429952 00000100:00100000:3.0:1788664370.680450:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 235 00000100:00100000:3.0:1788664370.680460:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+29:11634:x1875550204429952:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788664370.680569:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680600:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680611:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680813:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680822:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680828:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680834:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b2800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664370.680838:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680846:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680858:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:3.0:1788664370.680861:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788664370.680866:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664370.680885:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2800/0x762f55027be91125 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664370.681046:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+30:11634:x1875550204429952:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 586us (782us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788664370.681054:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 235 00000040:00080000:2.0:1788664370.682174:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788664370.682181:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664370.683045:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788664370.683056:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664370.685877:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664370.685919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.686003:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204430208 00000100:00100000:1.0:1788664370.686013:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204430208 00000100:00100000:1.0:1788664370.686051:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204429696 00000100:00100000:1.0:1788664370.686053:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204429696 00000100:00100000:1.0:1788664370.686066:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:1.0:1788664370.686076:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:11634:x1875550204430208:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788664370.686325:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11634:x1875550204430208:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 250us (458us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788664370.686333:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 63 00000100:00100000:1.0:1788664370.686385:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:1.0:1788664370.686392:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+31:5600:x1875550204429696:12345-192.168.202.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788664370.688018:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+32:5600:x1875550204429696:12345-192.168.202.14@tcp:35:ldlm_bl.0 Request processed in 1615us (2088us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788664370.688030:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 64 00000100:00100000:0.0:1788664370.692042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664370.692278:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204430336 00000100:00100000:1.0:1788664370.692289:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204430336 00010000:00010000:1.0:1788664370.692332:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 32 pid: 7653 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664370.692425:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:1.0:1788664370.692436:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+32:2360:x1875550204430336:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664370.692453:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664370.692460:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 32 pid: 7653 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.692488:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 32 pid: 7653 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.692522:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91014 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a84 expref: 32 pid: 7653 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.692539:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:1.0:1788664370.692545:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.692556:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.692564:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664370.692607:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664370.692673:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+31:2360:x1875550204430336:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 239us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664370.692680:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00010000:00010000:2.0:1788664370.692811:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692820:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664370.692867:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788664370.692873:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664370.692895:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692909:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692919:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692933:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692940:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692946:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664370.692950:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692957:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692966:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664370.692969:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664370.692973:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692978:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2a00/0x762f55027be910fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692991:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.692998:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693003:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693008:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664370.693018:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693024:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693032:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b68dc969800) 00010000:00010000:2.0:1788664370.693035:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664370.693037:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693043:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be91102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693081:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be910f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ac3 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693095:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ac3 expref: 30 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664370.693103:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664370.693105:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664370.693108:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef400, rc 0) 00000100:00100000:2.0:1788664370.693135:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+30:11635:x1875550204429184:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 22006us (22512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664370.693142:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 233 00010000:00010000:3.0:1788664370.984053:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664371.637811:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664371.637874:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664371.637903:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664371.637919:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664371.637940:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664371.637963:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204430848 00000100:00100000:3.0:1788664371.637972:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204430848 00000100:00100000:3.0:1788664371.638026:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204430720 00000100:00100000:3.0:1788664371.638029:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204430720 00000100:00100000:3.0:1788664371.638049:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:3.0:1788664371.638059:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204430848:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664371.638130:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204430848:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664371.638137:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:3.0:1788664371.638152:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:3.0:1788664371.638159:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204430720:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664371.638182:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2358:x1875550204430720:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664371.638206:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:3.0:1788664371.638225:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204430464 00000100:00100000:3.0:1788664371.638229:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204430464 00000100:00100000:3.0:1788664371.638253:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 302 00000100:00100000:3.0:1788664371.638260:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204430464:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664371.638285:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2358:x1875550204430464:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664371.638292:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 302 00000100:00100000:3.0:1788664371.638322:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204430592 00000100:00100000:3.0:1788664371.638325:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204430592 00000100:00100000:3.0:1788664371.638379:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204430976 00000100:00100000:3.0:1788664371.638383:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204430976 00000100:00100000:3.0:1788664371.638404:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:3.0:1788664371.638411:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+30:2359:x1875550204430592:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664371.638457:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+30:2359:x1875550204430592:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 47us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664371.638464:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 170 00000100:00100000:3.0:1788664371.638475:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00100000:3.0:1788664371.638482:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204430976:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664371.638505:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2358:x1875550204430976:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664371.638510:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 171 00000100:00080000:3.0:1788664371.638526:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664371.638530:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788664372.002072:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664372.139218:0:12575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664372.139228:0:12575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664372.139293:0:12575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788664372.139299:0:12575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788664372.449984:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664372.450149:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204431232 00000100:00100000:2.0:1788664372.450161:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204431232 00000100:00100000:2.0:1788664372.450235:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 236 00000100:00100000:2.0:1788664372.450245:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+30:11658:x1875550204431232:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664372.450275:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664372.450297:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9112c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243ad1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.450474:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be91133 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.450493:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be91133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.450509:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be91133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664372.450522:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788664372.450695:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eba00/0x762f55027be9112c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ad1 expref: 33 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.450716:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be91133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ad1 expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.450724:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664372.450727:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788664372.450731:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eaa00, rc 0) 00000100:00100000:2.0:1788664372.450795:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11658:x1875550204431232:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 551us (822us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788664372.450802:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 236 00000100:00100000:3.0:1788664372.459776:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664372.459836:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204431360 00000100:00100000:2.0:1788664372.459846:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204431360 00000100:00100000:2.0:1788664372.459922:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 237 00000100:00100000:2.0:1788664372.459941:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11658:x1875550204431360:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:2.0:1788664372.460013:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460031:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460042:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460068:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460075:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460082:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460088:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664372.460092:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460099:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460110:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664372.460113:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664372.460118:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664372.460125:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ea200/0x762f55027be91141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664372.460205:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+32:11658:x1875550204431360:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 266us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664372.460213:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 237 00000100:00100000:2.0:1788664372.536933:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664372.546337:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204431488 00000100:00100000:1.0:1788664372.546398:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204431488 00000100:00100000:1.0:1788664372.546506:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:1.0:1788664372.546521:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204431488:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:1.0:1788664372.546543:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664372.546567:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe7d4578/0x762f55027be91148 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243ad8 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664372.546600:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9cda32, atime: 0x6a9cda32, ctime: 0x6a9cda32, blocks: 0xb 00010000:00010000:1.0:1788664372.546628:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1788664372.546703:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664372.546715:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe7d4578/0x762f55027be91148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ad8 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664372.546805:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe7d4578/0x762f55027be91148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ad8 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664372.546825:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3600, rc 0) 00000100:00080000:0.0:1788664372.548454:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664372.561841:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2361:x1875550204431488:12345-192.168.202.14@tcp:101:cat.0 Request processed in 15312us (24904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664372.561856:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 74 00000100:00100000:3.0:1788664372.572084:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664372.573174:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204431616 00000100:00100000:3.0:1788664372.573185:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204431616 00002000:00100000:3.0:1788664372.573235:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b68e7f05c00 x1875550204431616/t0(0) o3->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:678/0 lens 488/0 e 0 to 0 dl 1788664383 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664372.573245:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68e7f05c00 with x1875550204431616 ext(0->4095) 00002000:00010000:3.0:1788664372.573251:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68e7f05c00 00000100:00100000:3.0:1788664372.573283:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:3.0:1788664372.573293:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2359:x1875550204431616:12345-192.168.202.14@tcp:3:cat.0 00000100:00100000:3.0:1788664372.574456:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+8:2359:x1875550204431616:12345-192.168.202.14@tcp:3:cat.0 Request processed in 1159us (2377us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788664372.574525:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00002000:00100000:3.0:1788664372.574535:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9b68e7f05c00 x1875550204431616/t0(0) o3->5e600724-38bd-4119-be7d-5264f08f0aa5@192.168.202.14@tcp:678/0 lens 488/4536 e 0 to 0 dl 1788664383 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788664372.574545:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b68e7f05c00 with x1875550204431616 ext(0->4095) 00002000:00010000:3.0:1788664372.574550:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b68e7f05c00 00010000:00010000:2.0:1788664373.025766:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788664373.135806:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788664373.135828:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788664373.135832:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788664373.542047:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222240256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664373.542163:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664373.542303:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222240256 00000100:00100000:1.0:1788664373.542312:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222240256 00000100:00100000:1.0:1788664373.542405:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788664373.542417:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222240256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664373.542452:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788664373.542548:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664373.552135:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222240256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9711us (9962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664373.552151:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788664373.557039:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222240256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664374.048497:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664375.073015:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664375.073332:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222240512:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.073447:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664375.073523:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222241024:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.073549:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664375.073583:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664375.073589:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222240384:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.073618:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664375.073639:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222240896:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.073660:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664375.073690:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241024 00000100:00100000:2.0:1788664375.073698:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241024 00000100:00100000:2.0:1788664375.073753:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788664375.073762:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222241024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.073814:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222241024:12345-0@lo:400:kworker.0 Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664375.073838:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788664375.073876:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222240384 00000100:00100000:2.0:1788664375.073880:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222240384 00000100:00100000:2.0:1788664375.073907:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788664375.073913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222240384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.073957:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222240384:12345-0@lo:400:kworker.0 Request processed in 44us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664375.073963:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788664375.073994:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222240512 00000100:00100000:2.0:1788664375.073997:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222240512 00000100:00100000:2.0:1788664375.074021:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222240896 00000100:00100000:2.0:1788664375.074024:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222240896 00000100:00100000:2.0:1788664375.074041:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788664375.074048:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222240512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.074076:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222240512:12345-0@lo:400:kworker.0 Request processed in 29us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664375.074082:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788664375.074093:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788664375.074099:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222240896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.074123:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222240896:12345-0@lo:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664375.074128:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1788664375.074144:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788664375.074157:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664375.074195:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222240384:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.074209:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222240896:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.074217:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222240512:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.074224:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788664375.074230:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788664375.074251:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b68f8f8ca80, transno 4294967310 00000100:00100000:2.0:1788664375.074295:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222241024:0@lo:400:kworker.0 00000100:00100000:0.0:1788664375.075044:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222240768:0@lo:400:kworker.0 00000100:00100000:0.0:1788664375.075090:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664375.075123:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664375.075130:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222240640:0@lo:400:kworker.0 00000100:00100000:0.0:1788664375.075164:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664375.075193:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222240640 00000100:00100000:0.0:1788664375.075198:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222240640 00000100:00100000:0.0:1788664375.075236:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788664375.075243:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222240640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664375.075292:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222240640:12345-0@lo:400:kworker.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664375.075298:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1788664375.075316:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664375.075333:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222240640:0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.075656:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222240768 00000100:00100000:2.0:1788664375.075660:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222240768 00000100:00100000:2.0:1788664375.075707:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788664375.075715:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222240768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664375.075754:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222240768:12345-0@lo:400:kworker.0 Request processed in 40us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664375.075761:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788664375.077982:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664375.078048:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222240768:0@lo:400:kworker.0 00000100:00100000:1.0:1788664375.596625:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222241152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664375.596735:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664375.598842:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241152 00000100:00100000:2.0:1788664375.598855:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241152 00000100:00100000:2.0:1788664375.598907:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788664375.598917:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222241152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664375.598958:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664375.599055:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222241152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664375.599063:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788664375.599135:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222241152:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788664375.739562:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788664375.739579:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1788664375.763779:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:0.0:1788664375.763798:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:0.0:1788664375.763813:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788664375.763835:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b68c12ed300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788664375.763841:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68f85b9b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b68c12edc00 00000020:00080000:0.0:1788664375.763844:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9b68f85b9f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b68fb7e7c00 00000020:00080000:0.0:1788664375.763867:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788664375.763868:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000004:00080000:0.0:1788664375.763876:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788664375.764053:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788664376.095483:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664376.758272:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664376.758321:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664376.758521:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204431872 00000100:00100000:0.0:1788664376.758530:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204431872 00000100:00100000:0.0:1788664376.758603:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:0.0:1788664376.758627:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2359:x1875550204431872:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664376.758702:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2359:x1875550204431872:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664376.758710:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 175 00000100:00100000:3.0:1788664376.758734:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204432128 00000100:00100000:3.0:1788664376.758739:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204432128 00000100:00100000:3.0:1788664376.758771:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00100000:3.0:1788664376.758778:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204432128:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664376.758806:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204432128:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664376.758819:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 104 00000100:00080000:1.0:1788664376.758889:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664376.758894:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664376.761972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664376.762002:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664376.762041:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664376.762312:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204432000 00000100:00100000:2.0:1788664376.762320:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204432000 00000100:00100000:2.0:1788664376.762386:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:2.0:1788664376.762393:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204432000:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664376.762464:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204432000:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 70us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664376.762485:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:2.0:1788664376.762513:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204431744 00000100:00100000:2.0:1788664376.762516:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204431744 00000100:00100000:2.0:1788664376.762531:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 304 00000100:00100000:2.0:1788664376.762535:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204431744:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664376.762556:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204431744:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 21us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664376.762560:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 304 00000100:00100000:0.0:1788664376.762813:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204432256 00000100:00100000:0.0:1788664376.762818:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204432256 00000100:00100000:0.0:1788664376.762858:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00100000:0.0:1788664376.762866:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204432256:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664376.762891:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8ced180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2359:x1875550204432256:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664376.762895:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 176 00000100:00080000:1.0:1788664376.762991:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788664376.762995:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788664377.127368:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664378.161983:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664378.661383:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222241280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664378.661449:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664378.661520:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241280 00000100:00100000:2.0:1788664378.661527:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241280 00000100:00100000:2.0:1788664378.661578:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788664378.661586:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222241280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664378.661632:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664378.661671:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222241280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664378.661678:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788664378.661697:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664378.661721:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788664378.661727:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788664378.661754:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222241280:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788664378.911684:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664378.911696:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664378.912080:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788664378.912087:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788664379.048280:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664379.048434:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204432384 00000100:00100000:2.0:1788664379.048446:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204432384 00000100:00100000:2.0:1788664379.048536:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 238 00000100:00100000:2.0:1788664379.048561:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11318:x1875550204432384:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788664379.048709:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11318:x1875550204432384:12345-192.168.202.14@tcp:60:lhsmtool_posix.0 Request processed in 150us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664379.048717:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 238 00000100:00080000:1.0:1788664379.048860:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664379.056185:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664379.056477:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204432640 00000100:00100000:0.0:1788664379.056490:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204432640 00000100:00100000:0.0:1788664379.056562:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 65 00000100:00100000:0.0:1788664379.056575:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+19:11318:x1875550204432640:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788664379.056926:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:11318:x1875550204432640:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 352us (753us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788664379.056934:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 65 00010000:00010000:2.0:1788664379.167746:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664379.744280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664379.744430:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204432768 00000100:00100000:0.0:1788664379.744441:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204432768 00000100:00100000:0.0:1788664379.744526:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 239 00000100:00100000:0.0:1788664379.744572:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:12109:x1875550204432768:12345-192.168.202.14@tcp:101:lsof.0 00010000:00010000:0.0:1788664379.744608:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664379.744642:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9114f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243adf expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664379.744733:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be91156 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664379.744749:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be91156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664379.744762:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be91156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664379.744802:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788664379.744806:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664379.744835:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be91156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664379.744864:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef800/0x762f55027be9114f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243adf expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664379.744895:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be91156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243adf expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664379.744904:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:0.0:1788664379.744907:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664379.744911:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef200, rc 0) 00000100:00100000:0.0:1788664379.744988:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:12109:x1875550204432768:12345-192.168.202.14@tcp:101:lsof.0 Request processed in 421us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664379.745007:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 239 00000100:00080000:1.0:1788664379.745103:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664380.191922:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222241792:0@lo:400:kworker.0 00000100:00100000:1.0:1788664380.192032:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664380.192114:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664380.192122:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222241664:0@lo:400:kworker.0 00000100:00100000:1.0:1788664380.192153:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664380.192202:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241792 00000100:00100000:1.0:1788664380.192225:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241792 00000100:00100000:1.0:1788664380.192306:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788664380.192318:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222241792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664380.192478:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222241792:12345-0@lo:400:kworker.0 Request processed in 162us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664380.192485:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1788664380.192507:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664380.192522:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241664 00000100:00100000:1.0:1788664380.192526:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241664 00000100:00100000:2.0:1788664380.192561:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f9023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222241536:0@lo:400:kworker.0 00000100:00100000:1.0:1788664380.192563:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788664380.192591:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222241664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664380.192608:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664380.192630:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222241664:12345-0@lo:400:kworker.0 Request processed in 41us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664380.192638:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788664380.192651:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241536 00000100:00100000:1.0:1788664380.192654:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241536 00000100:00100000:2.0:1788664380.192659:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222242048:0@lo:400:kworker.0 00000100:00100000:1.0:1788664380.192679:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788664380.192689:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222241536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664380.192695:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664380.192730:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222241536:12345-0@lo:400:kworker.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664380.192737:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788664380.192753:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f9023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222241536:0@lo:400:kworker.0 00000100:00080000:1.0:1788664380.192758:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664380.192785:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788664380.192795:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222241408:0@lo:400:kworker.0 00000100:00100000:1.0:1788664380.192796:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222241664:0@lo:400:kworker.0 00000100:00100000:1.0:1788664380.192813:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222241792:0@lo:400:kworker.0 00000100:00100000:2.0:1788664380.192837:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664380.192867:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c5f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222241920:0@lo:400:kworker.0 00000100:00100000:2.0:1788664380.192891:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664380.192934:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241408 00000100:00100000:2.0:1788664380.192938:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241408 00000100:00100000:2.0:1788664380.192976:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788664380.192984:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222241408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664380.192999:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242048 00000100:00100000:3.0:1788664380.193005:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242048 00000100:00100000:2.0:1788664380.193029:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3310:x1875550222241408:12345-0@lo:400:kworker.0 Request processed in 46us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664380.193038:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788664380.193052:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788664380.193063:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222242048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664380.193102:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222242048:12345-0@lo:400:kworker.0 Request processed in 43us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664380.193109:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788664380.193136:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25199117-f21d-4733-8eaf-e8fb9fef1d54:3310:1875550222241408:0@lo:400:kworker.0 00010000:00010000:3.0:1788664380.193142:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664380.193150:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222242048:0@lo:400:kworker.0 00000100:00080000:3.0:1788664380.193151:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664380.193248:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222241920 00000100:00100000:0.0:1788664380.193253:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222241920 00000100:00100000:0.0:1788664380.193301:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788664380.193309:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222241920:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788664380.193465:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664380.193542:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875550222241920:12345-0@lo:400:kworker.0 Request processed in 233us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664380.193549:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788664380.194879:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c5f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222241920:0@lo:400:kworker.0 00000100:00100000:2.0:1788664380.705007:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222242176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664380.705126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664380.705261:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242176 00000100:00100000:3.0:1788664380.705271:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242176 00000100:00100000:3.0:1788664380.705326:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788664380.705334:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222242176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788664380.705396:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664380.705439:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222242176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664380.705445:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788664380.705529:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222242176:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788664380.790165:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788664380.790295:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788664380.790362:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788664380.790379:0:5887:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788664381.217227:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664381.887567:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664381.887633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664381.887696:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664381.887713:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664381.887753:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664381.887789:0:12075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433152 00000100:00100000:0.0:1788664381.887790:0:8476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433280 00000100:00100000:1.0:1788664381.887803:0:12075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433152 00000100:00100000:0.0:1788664381.887803:0:8476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433280 00000100:00100000:0.0:1788664381.887920:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:2.0:1788664381.887927:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204432896 00000100:00100000:2.0:1788664381.887944:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204432896 00000100:00100000:0.0:1788664381.887946:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204433280:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664381.887981:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 306 00000100:00100000:2.0:1788664381.888001:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204432896:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664381.888056:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2361:x1875550204433280:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664381.888064:0:12075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:0.0:1788664381.888068:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:1.0:1788664381.888071:0:12075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204433152:12345-192.168.202.14@tcp:400:kworker.0 00000100:00080000:0.0:1788664381.888155:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664381.888161:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664381.888173:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433024 00000100:00100000:0.0:1788664381.888178:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433024 00000100:00100000:0.0:1788664381.888210:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433408 00000100:00100000:0.0:1788664381.888213:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433408 00000100:00100000:0.0:1788664381.888232:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 180 00000100:00100000:0.0:1788664381.888238:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2361:x1875550204433024:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664381.894302:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204432896:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 6288us (6578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664381.894330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 306 00000100:00100000:2.0:1788664381.894491:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 181 00000100:00100000:2.0:1788664381.894518:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2361:x1875550204433408:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664381.894599:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2361:x1875550204433408:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 94us (6846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664381.894606:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 181 00000100:00080000:2.0:1788664381.894769:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664381.905868:0:12075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2361:x1875550204433152:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 17777us (18133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664381.905868:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2361:x1875550204433024:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 17608us (18302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664381.905908:0:12075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:0.0:1788664381.905908:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 180 00010000:00010000:2.0:1788664382.239527:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664383.265883:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664383.780260:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664383.780302:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788664383.780420:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664383.780490:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242304 00000100:00100000:3.0:1788664383.780499:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242304 00000100:00100000:3.0:1788664383.780560:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788664383.780568:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222242304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664383.780611:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664383.780657:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222242304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664383.780663:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788664383.780684:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664383.780721:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222242304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788664384.287698:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788664384.623631:0:12781:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:13:03 (1788664383) 00000100:00100000:0.0:1788664385.311786:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222242816:0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.311787:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222242432:0@lo:400:kworker.0 00000100:00100000:1.0:1788664385.311854:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222242560:0@lo:400:kworker.0 00010000:00010000:2.0:1788664385.311948:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664385.316020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664385.316096:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222242944:0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.316134:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664385.316184:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222242688:0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.316209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664385.317013:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242432 00000100:00100000:3.0:1788664385.317023:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242432 00000100:00100000:3.0:1788664385.317071:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788664385.317080:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222242432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.317139:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222242432:12345-0@lo:400:kworker.0 Request processed in 60us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664385.317147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788664385.317182:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242944 00000100:00100000:3.0:1788664385.317192:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242944 00000100:00100000:3.0:1788664385.317229:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242688 00000100:00100000:3.0:1788664385.317232:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242688 00000100:00100000:0.0:1788664385.317253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664385.318663:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788664385.318676:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222242944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.318739:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222242944:12345-0@lo:400:kworker.0 Request processed in 67us (2604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664385.318746:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788664385.318760:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788664385.318767:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222242688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.318803:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222242688:12345-0@lo:400:kworker.0 Request processed in 37us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664385.318809:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1788664385.318839:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664385.318854:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242816 00000100:00100000:3.0:1788664385.318859:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242816 00000100:00100000:3.0:1788664385.318891:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788664385.318897:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222242816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.318930:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222242816:12345-0@lo:400:kworker.0 Request processed in 33us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664385.318935:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1788664385.318948:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664385.318979:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222242688:0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.319011:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222242432:0@lo:400:kworker.0 00000100:00100000:3.0:1788664385.319021:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222242944:0@lo:400:kworker.0 00000100:00100000:0.0:1788664385.320973:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222242816:0@lo:400:kworker.0 00000100:00100000:1.0:1788664385.321112:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664385.321151:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222243072:0@lo:400:kworker.0 00000100:00100000:1.0:1788664385.321181:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664385.321366:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243072 00000100:00100000:0.0:1788664385.321372:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243072 00000100:00100000:0.0:1788664385.321429:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788664385.321438:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222243072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664385.321489:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222243072:12345-0@lo:400:kworker.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664385.321496:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1788664385.321556:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788664385.321585:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222243072:0@lo:400:kworker.0 00000100:00100000:2.0:1788664385.322066:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222242560 00000100:00100000:2.0:1788664385.322071:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222242560 00000100:00100000:2.0:1788664385.322144:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788664385.322153:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222242560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664385.322204:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875550222242560:12345-0@lo:400:kworker.0 Request processed in 54us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664385.322219:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788664385.322286:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875550222242560:0@lo:400:kworker.0 00000100:00100000:0.0:1788664385.838079:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664385.838103:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222243200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664385.841316:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664385.842011:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243200 00000100:00100000:2.0:1788664385.842022:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243200 00000100:00100000:2.0:1788664385.842079:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788664385.842090:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222243200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664385.843092:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664385.843264:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222243200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1174us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664385.843275:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788664385.844802:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222243200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788664386.335708:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664386.998666:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664386.998704:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664386.998776:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664386.998803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664386.998833:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664386.998864:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433536 00000100:00100000:0.0:1788664386.998868:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433792 00000100:00100000:3.0:1788664386.998873:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433536 00000100:00100000:0.0:1788664386.998875:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433792 00000100:00100000:3.0:1788664386.998927:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 308 00000100:00100000:0.0:1788664386.998928:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433920 00000100:00100000:0.0:1788664386.998933:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433920 00000100:00100000:3.0:1788664386.998941:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204433536:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664386.998964:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:0.0:1788664386.998974:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204433792:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664386.999014:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2359:x1875550204433536:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 77us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664386.999017:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2359:x1875550204433792:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 43us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664386.999027:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 308 00000100:00100000:0.0:1788664386.999032:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:0.0:1788664386.999061:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00100000:0.0:1788664386.999069:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204433920:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664386.999075:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204434048 00000100:00100000:3.0:1788664386.999081:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204434048 00000100:00100000:0.0:1788664386.999102:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2359:x1875550204433920:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664386.999108:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 113 00000100:00080000:0.0:1788664386.999126:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664386.999131:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664386.999133:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664386.999227:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204433664 00000100:00100000:3.0:1788664386.999231:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204433664 00000100:00100000:3.0:1788664386.999278:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 185 00000100:00100000:3.0:1788664386.999286:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2359:x1875550204434048:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664386.999319:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 186 00000100:00100000:3.0:1788664386.999321:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2359:x1875550204434048:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 35us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664386.999335:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 185 00000100:00100000:2.0:1788664386.999337:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2359:x1875550204433664:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664386.999395:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+19:2359:x1875550204433664:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 66us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664386.999403:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 186 00000100:00080000:2.0:1788664386.999425:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788664387.359717:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664388.129080:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788664388.129090:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664388.129479:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788664388.129486:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788664388.383634:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664388.744266:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664388.744394:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204434304 00000100:00100000:0.0:1788664388.744407:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204434304 00000100:00100000:0.0:1788664388.744531:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00100000:0.0:1788664388.744543:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+19:12331:x1875550204434304:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:0.0:1788664388.744967:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5e600724-38bd-4119-be7d-5264f08f0aa5+20:12331:x1875550204434304:12345-192.168.202.14@tcp:35:umount.0 Request processed in 426us (711us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788664388.744975:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 66 00000100:00080000:2.0:1788664388.748095:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664388.749538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664388.749648:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204434560 00000100:00100000:1.0:1788664388.749658:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204434560 00000100:00100000:1.0:1788664388.749705:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:1.0:1788664388.749715:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+20:12331:x1875550204434560:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:1.0:1788664388.750095:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+21:12331:x1875550204434560:12345-192.168.202.14@tcp:35:umount.0 Request processed in 379us (566us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788664388.750104:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 67 00000100:00100000:3.0:1788664388.755068:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664388.755295:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204434816 00000100:00100000:1.0:1788664388.755306:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204434816 00000100:00100000:1.0:1788664388.755399:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:1.0:1788664388.755410:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c7eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+21:12331:x1875550204434816:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:1.0:1788664388.755670:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c7eb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+22:12331:x1875550204434816:12345-192.168.202.14@tcp:35:umount.0 Request processed in 262us (612us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788664388.755693:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 68 00000100:00100000:2.0:1788664388.760185:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664388.760681:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204435072 00000100:00100000:1.0:1788664388.760693:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204435072 00000100:00100000:1.0:1788664388.760780:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:1.0:1788664388.760793:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+22:12331:x1875550204435072:12345-192.168.202.14@tcp:35:umount.0 00000100:00100000:1.0:1788664388.761433:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+23:12331:x1875550204435072:12345-192.168.202.14@tcp:35:umount.0 Request processed in 640us (1255us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788664388.761453:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 69 00000100:00100000:3.0:1788664388.778637:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664388.778679:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664388.778871:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204435200 00000100:00100000:2.0:1788664388.778881:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204435200 00000100:00100000:2.0:1788664388.778932:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204435328 00000100:00100000:2.0:1788664388.778935:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204435328 00000100:00100000:2.0:1788664388.778962:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788664388.778972:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c5893850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+14:2361:x1875550204435200:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664388.778990:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664388.779023:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512a000/0x762f55027be901c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24366a expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.779042:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664388.779098:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c5893850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+13:2361:x1875550204435200:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 128us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664388.779107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788664388.779159:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788664388.779166:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+12:2361:x1875550204435328:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664388.779174:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664388.779208:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ef000/0x762f55027be9012d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243632 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.779218:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664388.779238:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:2361:x1875550204435328:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 72us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664388.779244:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:3.0:1788664388.785467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664388.785750:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204435456 00000100:00100000:2.0:1788664388.785761:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204435456 00000100:00100000:2.0:1788664388.785845:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788664388.785856:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:2360:x1875550204435456:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664388.785874:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664388.785893:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b400/0x762f55027be903b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243735 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.785911:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664388.785969:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2360:x1875550204435456:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 115us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664388.785987:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788664388.787560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664388.787920:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204435584 00000100:00100000:0.0:1788664388.787930:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204435584 00000100:00100000:0.0:1788664388.788006:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 75 00000100:00100000:0.0:1788664388.788018:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+5:2357:x1875550204435584:12345-192.168.202.14@tcp:9:umount.0 00000100:00080000:2.0:1788664388.788037:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788664388.788052:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90b4b 00000100:00080000:0.0:1788664388.788063:0:6694:0:(import.c:65:import_set_state_nolock()) ffff9b68dff22000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664388.788119:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788664388.788134:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664388.788441:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5e600724-38bd-4119-be7d-5264f08f0aa5+2:2357:x1875550204435584:12345-192.168.202.14@tcp:9:umount.0 Request processed in 425us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664388.788458:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 75 00000100:00100000:3.0:1788664388.794201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664388.794415:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204435968 00000100:00100000:0.0:1788664388.794427:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204435968 00000100:00100000:0.0:1788664388.794557:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:0.0:1788664388.794567:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2357:x1875550204435968:12345-192.168.202.14@tcp:9:umount.0 00000020:00000080:0.0:1788664388.794599:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90707 00000020:00010000:0.0:1788664388.794606:0:6697:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b68d8575000: total 0 00000100:00080000:0.0:1788664388.794610:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b68fb24a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664388.794667:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1788664388.794909:0:5844:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b68d8575000: total 0 00010000:00010000:3.0:1788664388.794943:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b68d8575000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788664388.794994:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe7d4578/0x762f55027be91148 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ad8 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664388.795030:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000021ae140/0x762f55027be90aa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24390a expref: 5 pid: 12075 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664388.795047:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b68d8575000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788664388.795058:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664388.795060:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664388.795062:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664388.795503:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+2:2357:x1875550204435968:12345-192.168.202.14@tcp:9:umount.0 Request processed in 936us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664388.795521:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00080000:2.0:1788664388.795945:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788664388.804027:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664388.804110:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204436992 00000100:00100000:0.0:1788664388.804118:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204436992 00000100:00100000:0.0:1788664388.804168:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 240 00000100:00100000:0.0:1788664388.804175:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+23:2357:x1875550204436992:12345-192.168.202.14@tcp:39:umount.0 00000020:00000080:0.0:1788664388.804204:0:5856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be9013b 00000020:00010000:0.0:1788664388.804216:0:5856:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b68f85db000: total 0 00000100:00080000:0.0:1788664388.804219:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9b68f85df000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664388.804243:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:2.0:1788664388.804400:0:5843:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b68f85db000: total 0 00010000:00010000:2.0:1788664388.804454:0:5843:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b68f85db000, canceled 0 locks, left on hash table 14. 00010000:00010000:2.0:1788664388.804494:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664388.804498:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788664388.804505:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243aca expref: 22 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804535:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664388.804537:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664388.804541:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be9111e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ac3 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804555:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:2.0:1788664388.804557:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664388.804561:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be90b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243926 expref: 20 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804573:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e9affe00) 00010000:00010000:2.0:1788664388.804576:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664388.804580:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebc00/0x762f55027be90421 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24374a expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804597:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664388.804599:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664388.804754:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147ac00/0x762f55027be90a64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438f5 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804775:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664388.804777:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788664388.804779:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eaa00/0x762f55027be91133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243ad1 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804788:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b68e9aff700) 00010000:00010000:2.0:1788664388.804789:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788664388.804791:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12ebe00/0x762f55027be90405 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243743 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804800:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664388.804802:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788664388.804804:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2c00/0x762f55027be90a8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243903 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804813:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664388.804815:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788664388.804817:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c147b200/0x762f55027be90b21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24392d expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804823:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b68c3811600) 00010000:00010000:2.0:1788664388.804825:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664388.804827:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eac00/0x762f55027be90e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2439ff expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804835:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b68e9aff800) 00010000:00010000:2.0:1788664388.804841:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664388.804844:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c1478600/0x762f55027be90984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2438bd expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804854:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664388.804856:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788664388.804858:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eb400/0x762f55027be90475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24375f expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804865:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:2.0:1788664388.804867:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664388.804869:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee000/0x762f55027be91029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243a8b expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804876:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b68e9affd00) 00010000:00010000:2.0:1788664388.804878:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788664388.804880:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c12eae00/0x762f55027be90762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243831 expref: 9 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664388.804886:0:5843:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b68f85db000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1788664388.804897:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664388.804898:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664388.804900:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664388.805624:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5e600724-38bd-4119-be7d-5264f08f0aa5+7:2357:x1875550204436992:12345-192.168.202.14@tcp:39:umount.0 Request processed in 1437us (1593us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788664388.805635:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 240 00000100:00100000:0.0:1788664388.896891:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222243328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664388.897023:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664388.897179:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243328 00000100:00100000:2.0:1788664388.897187:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243328 00000100:00100000:2.0:1788664388.897251:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788664388.897261:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222243328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788664388.897297:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664388.897376:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222243328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664388.897391:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788664388.897444:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222243328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664388.899111:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788664389.408029:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664390.424677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664390.424829:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664390.425185:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664390.425255:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204437120 00000100:00100000:0.0:1788664390.425265:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204437120 00000100:00100000:0.0:1788664390.425337:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204437376 00000100:00100000:0.0:1788664390.425379:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204437376 00000100:00100000:0.0:1788664390.425408:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788664390.425418:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+11:2358:x1875550204437120:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664390.425435:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664390.425456:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512a400/0x762f55027be9020d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24367f expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664390.425472:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664390.425524:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+10:2358:x1875550204437120:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 108us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664390.425533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788664390.425550:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788664390.425557:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+9:2358:x1875550204437376:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664390.425565:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664390.425575:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147ba00/0x762f55027be903aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd24372e expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664390.425585:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664390.425601:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:2358:x1875550204437376:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 45us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664390.425608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:0.0:1788664390.425860:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204437248 00000100:00100000:0.0:1788664390.425865:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204437248 00000100:00100000:0.0:1788664390.425892:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:0.0:1788664390.425917:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+8:2358:x1875550204437248:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664390.426505:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664390.426523:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479200/0x762f55027be90214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd2436a9 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664390.426539:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664390.426565:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+7:2358:x1875550204437248:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 651us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664390.426572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:3.0:1788664390.428455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664390.428552:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204437632 00000100:00100000:2.0:1788664390.428560:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204437632 00000100:00100000:2.0:1788664390.428664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00100000:2.0:1788664390.428685:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+6:2357:x1875550204437632:12345-192.168.202.14@tcp:39:umount.0 00000020:00000080:2.0:1788664390.428854:0:5855:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90222 00000020:00010000:2.0:1788664390.428864:0:5855:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b68dfc69800: total 0 00000100:00080000:2.0:1788664390.428878:0:5855:0:(import.c:65:import_set_state_nolock()) ffff9b68dfc6e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788664390.428930:0:5855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1788664390.429646:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907eac49-0e74-41b0-b01e-8a20532e4f07+5:2357:x1875550204437632:12345-192.168.202.14@tcp:39:umount.0 Request processed in 962us (1197us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788664390.429656:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 241 00000100:00080000:0.0:1788664390.429769:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1788664390.429823:0:5844:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b68dfc69800: total 0 00010000:00010000:0.0:1788664390.429827:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664390.435595:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664390.435700:0:5844:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b68dfc69800, canceled 0 locks, left on hash table 1. 00000100:00100000:3.0:1788664390.435945:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222243456:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436022:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664390.436065:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222243968:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436089:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664390.436127:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788664390.436133:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222243584:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436156:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664390.436174:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222244096:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436200:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664390.436260:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222243712:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436285:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664390.436317:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664390.436323:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222243840:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436369:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664390.436412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243456 00000100:00100000:3.0:1788664390.436421:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243456 00000100:00100000:3.0:1788664390.436461:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788664390.436469:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222243456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436518:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222243456:12345-0@lo:400:kworker.0 Request processed in 49us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664390.436526:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788664390.436556:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244096 00000100:00100000:3.0:1788664390.436560:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244096 00000100:00100000:3.0:1788664390.436593:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243840 00000100:00100000:3.0:1788664390.436596:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243840 00000100:00100000:3.0:1788664390.436618:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788664390.436624:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222244096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.436658:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222244096:12345-0@lo:400:kworker.0 Request processed in 33us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664390.436665:0:8476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788664390.436677:0:8476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222243840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664390.436726:0:8476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222243840:12345-0@lo:400:kworker.0 Request processed in 53us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664390.436983:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788664390.437015:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243968 00000100:00100000:3.0:1788664390.437020:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243968 00000100:00100000:3.0:1788664390.437046:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243584 00000100:00100000:3.0:1788664390.437049:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243584 00000100:00100000:3.0:1788664390.437060:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222243712 00000100:00100000:3.0:1788664390.437062:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222243712 00000100:00100000:3.0:1788664390.437076:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788664390.437082:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222243968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437126:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222243968:12345-0@lo:400:kworker.0 Request processed in 45us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664390.437133:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788664390.437147:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788664390.437152:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222243584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437178:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222243584:12345-0@lo:400:kworker.0 Request processed in 26us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664390.437184:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788664390.437194:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788664390.437200:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222243712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437225:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222243712:12345-0@lo:400:kworker.0 Request processed in 26us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664390.437231:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:3.0:1788664390.437254:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664390.437259:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664390.437261:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664390.437296:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222243584:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437309:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222244096:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437317:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222243456:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437326:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222243968:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437488:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222243840:0@lo:400:kworker.0 00000100:00100000:3.0:1788664390.437498:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222243712:0@lo:400:kworker.0 00010000:00010000:0.0:1788664390.437658:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346e00) 00010000:00010000:0.0:1788664390.437662:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664390.437672:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef200/0x762f55027be91156 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243adf expref: 4 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664390.437697:0:5844:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b68dfc69800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788664390.437730:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664390.437733:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664390.437735:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664390.440481:0:8476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788664390.457254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664390.461543:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204437888 00000100:00100000:3.0:1788664390.461580:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204437888 00000100:00100000:3.0:1788664390.461657:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 310 00000100:00100000:3.0:1788664390.461670:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+7:2357:x1875550204437888:12345-192.168.202.14@tcp:251:umount.0 00000020:00000080:3.0:1788664390.461725:0:5848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90118 00000020:00010000:3.0:1788664390.461733:0:5848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b67c510f000: total 0 00000100:00080000:3.0:1788664390.461737:0:5848:0:(import.c:65:import_set_state_nolock()) ffff9b67c510b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788664390.461833:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c+3:2357:x1875550204437888:12345-192.168.202.14@tcp:251:umount.0 Request processed in 165us (4588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664390.461840:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 310 00000020:00010000:2.0:1788664390.461861:0:6710:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b67c510f000: total 0 00010000:00010000:2.0:1788664390.464906:0:6710:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b67c510f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788664390.464995:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512b800/0x762f55027be901ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243671 expref: 2 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664390.465014:0:6710:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b67c510f000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788664390.465044:0:6710:0:(genops.c:885:class_export_put()) final put ffff9b67c510f000/e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c 00010000:00010000:2.0:1788664390.465064:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664390.465067:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664390.465070:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788664390.465817:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b67c510f000/e0484b10-6a7d-4fa6-8786-b5c9ebfb0d7c for MGS 00000020:00000080:3.0:1788664390.465869:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b67c510b000 for MGS 00000100:00100000:2.0:1788664390.959210:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664390.959237:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222244224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664390.959310:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664390.959420:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244224 00000100:00100000:2.0:1788664390.959429:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244224 00000100:00100000:2.0:1788664390.959481:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788664390.959490:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222244224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664390.959533:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664390.959580:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222244224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664390.959587:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788664390.959638:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222244224:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788664391.057886:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:3.0:1788664391.057896:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b68d8575000/5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:3.0:1788664391.057923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68d8575000/5e600724-38bd-4119-be7d-5264f08f0aa5 for lustre-OST0000 00000020:00000080:3.0:1788664391.057962:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68fb24a000 for lustre-OST0000 00000001:00100000:0.0:1788664391.084518:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000001:00080000:0.0:1788664391.084539:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788664391.084561:0:5876:0:(genops.c:885:class_export_put()) final put ffff9b68f85db000/5e600724-38bd-4119-be7d-5264f08f0aa5 00000001:00100000:0.0:1788664391.084597:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 907eac49-0e74-41b0-b01e-8a20532e4f07 00000001:00080000:0.0:1788664391.084604:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788664391.084633:0:5876:0:(genops.c:885:class_export_put()) final put ffff9b68dfc69800/907eac49-0e74-41b0-b01e-8a20532e4f07 00000020:00000080:3.0:1788664391.084730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f85db000/5e600724-38bd-4119-be7d-5264f08f0aa5 for lustre-MDT0000 00000020:00000080:3.0:1788664391.084810:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68dfc69800/907eac49-0e74-41b0-b01e-8a20532e4f07 for lustre-MDT0000 00000020:00000080:3.0:1788664391.084835:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f85df000 for lustre-MDT0000 00000020:00000080:3.0:1788664391.084840:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68dfc6e800 for lustre-MDT0000 00010000:00010000:3.0:1788664391.456723:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664392.479554:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788664392.992039:0:12981:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:1.0:1788664393.002507:0:12981:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788664393.002557:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.002572:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.002580:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.002588:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.002621:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788664393.002628:0:12981:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788664393.002650:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788664393.002654:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788664393.002660:0:12981:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788664393.003269:0:12981:0:(import.c:65:import_set_state_nolock()) ffff9b68f7d61000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788664393.003769:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664393.003783:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.003793:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664393.003797:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.003814:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664393.003822:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664393.003827:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788664393.003830:0:6710:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788664393.003832:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788664393.003860:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664393.003869:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222244352:0@lo:39:umount.0 00010000:00010000:2.0:1788664393.003883:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788664393.003938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788664393.004140:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.004150:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1479800/0x762f55027be9019d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be901a4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.004172:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664393.004175:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664393.004178:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664393.004190:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222244480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664393.004234:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664393.004814:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244352 00000100:00100000:0.0:1788664393.004815:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244480 00000100:00100000:1.0:1788664393.004825:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244352 00000100:00100000:0.0:1788664393.004825:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244480 00000100:00100000:1.0:1788664393.004881:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788664393.004884:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664393.004893:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875550222244352:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788664393.004921:0:7653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8ff27 00000100:00080000:1.0:1788664393.004930:0:7653:0:(import.c:65:import_set_state_nolock()) ffff9b68c614c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788664393.004996:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3306:x1875550222244352:12345-0@lo:39:umount.0 Request processed in 106us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664393.005004:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788664393.005014:0:7653:0:(genops.c:885:class_export_put()) final put ffff9b68def82000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788664393.005165:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68def82000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788664393.005216:0:12947:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68c614c000 for lustre-MDT0000 00010000:00010000:3.0:1788664393.005660:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664393.005705:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f7d61000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788664393.005724:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222244352:0@lo:39:umount.0 00000100:00100000:0.0:1788664393.005767:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222244480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664393.005782:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664393.005800:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512b600/0x762f55027be901a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be9019d expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.005814:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664393.005861:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:3308:x1875550222244480:12345-0@lo:103:ldlm_bl.0 Request processed in 969us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664393.005868:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788664393.006049:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222244480:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788664393.006317:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788664393.006322:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788664393.006328:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788664393.007286:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007303:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007313:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007336:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007376:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664393.007383:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007391:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007398:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007405:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007421:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788664393.007427:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007434:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007441:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007448:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007476:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788664393.007484:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007491:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007498:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007505:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.007513:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788664393.007517:0:12981:0:(mgc_request.c:545:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788664393.007530:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788664393.007539:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788664393.007539:0:12981:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788664393.007545:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1788664393.007551:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ae00 already unused, calling callback (ffffffffc1bb5c20) 00000020:00000080:1.0:1788664393.007553:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1788664393.007557:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788664393.007560:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788664393.007569:0:12981:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b67c536d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1788664393.007573:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788664393.007579:0:12981:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9b68df62a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1788664393.007586:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788664393.007589:0:12981:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9b68c9200000) has exports, disconnecting them 10000000:01000000:2.0:1788664393.007597:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:1.0:1788664393.007597:0:12981:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b67c536d000), last request at 1788664390 00000020:00000080:1.0:1788664393.007605:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be9009a 10000000:01000000:2.0:1788664393.007609:0:6710:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788664393.007613:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00080000:1.0:1788664393.007624:0:12981:0:(import.c:65:import_set_state_nolock()) ffff9b67c536d800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788664393.007646:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788664393.007665:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b67c536d000): rc 0 00000020:00000080:1.0:1788664393.007669:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b67c536d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788664393.007678:0:12981:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b68df62a000), last request at 1788664390 00000020:00000080:1.0:1788664393.007688:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8ffcf 00000100:00080000:1.0:1788664393.007693:0:12981:0:(import.c:65:import_set_state_nolock()) ffff9b68df62b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788664393.007701:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b68df62a000): rc 0 00000020:00000080:1.0:1788664393.007703:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68df62a000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788664393.007710:0:12981:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac804227bae8 00010000:00010000:2.0:1788664393.007728:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1788664393.007729:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788664393.007733:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788664393.007750:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1788664393.007756:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.007765:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c512ae00/0x762f55027be901ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be901b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.007777:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788664393.007780:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.007786:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215be00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664393.007789:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.007797:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664393.007804:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664393.007810:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00080000:1.0:1788664393.007811:0:12981:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 10000000:01000000:2.0:1788664393.007815:0:6710:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788664393.007818:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:1.0:1788664393.007826:0:12981:0:(import.c:65:import_set_state_nolock()) ffff9b68f808b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788664393.007835:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788664393.007839:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788664393.007842:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788664393.007851:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1788664393.007856:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664393.007865:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.007873:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215be00/0x762f55027be900d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be900d9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788664393.007921:0:12981:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788664393.007930:0:12981:0:(import.c:65:import_set_state_nolock()) ffff9b68fb58b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788664393.007955:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b68c9200000) has no exports 00010000:00010000:0.0:1788664393.007993:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664393.008000:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.008007:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b690215aa00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664393.008010:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.008018:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664393.008025:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664393.008040:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788664393.008042:0:5844:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788664393.008044:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788664393.008058:0:5844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.008064:0:5844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664393.008087:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.008095:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b690215aa00/0x762f55027be8fe86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be8fe8d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.008108:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664393.008110:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664393.008112:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664393.008119:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664393.008134:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222245120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664393.008202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664393.008263:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222245120 00000100:00100000:0.0:1788664393.008270:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222245120 00000100:00100000:0.0:1788664393.008316:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664393.008325:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c6024050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+18:3308:x1875550222245120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664393.008359:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664393.008374:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c0030000/0x762f55027be8fe8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be8fe86 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.008390:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664393.008486:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664393.008492:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.008499:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1479600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664393.008502:0:6710:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.008510:0:6710:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664393.008517:0:6710:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664393.008525:0:6710:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788664393.008529:0:6710:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788664393.008532:0:6710:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788664393.008553:0:6710:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.008559:0:6710:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664393.008582:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664393.008588:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664393.008602:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222244608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664393.008614:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1479600/0x762f55027be903d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be903db expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.008629:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664393.008631:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664393.008634:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664393.008641:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788664393.008645:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b67c536d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1788664393.008669:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664393.008732:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222244864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664393.008756:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788664393.009010:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68df62a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788664393.009047:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b67c536d800 for lustre-MDT0000 00000020:00000080:2.0:1788664393.009054:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68df62b000 for lustre-MDT0000 00000100:00100000:2.0:1788664393.009072:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664393.009084:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222245248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664393.009119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664393.009156:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244608 00000100:00100000:2.0:1788664393.009163:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244608 00000100:00100000:2.0:1788664393.009190:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244864 00000100:00100000:2.0:1788664393.009193:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244864 00000100:00100000:2.0:1788664393.009202:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222245248 00000100:00100000:2.0:1788664393.009204:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222245248 00000100:00100000:2.0:1788664393.009216:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664393.009233:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+20:3309:x1875550222244608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664393.009243:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664393.009253:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147be00/0x762f55027be901b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be901ab expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664393.009266:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664393.009267:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222244736:0@lo:9:umount.0 00000100:00100000:3.0:1788664393.009309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664393.009316:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3309:x1875550222244608:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664393.009334:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222244992:0@lo:9:umount.0 00000100:00100000:2.0:1788664393.009338:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664393.010019:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c6024050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+19:3308:x1875550222245120:12345-0@lo:103:ldlm_bl.0 Request processed in 1694us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664393.010896:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25199117-f21d-4733-8eaf-e8fb9fef1d54:3308:1875550222245120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664393.011789:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788664393.011858:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664393.011870:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+17:3309:x1875550222244864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664393.011900:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664393.011920:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b690215b400/0x762f55027be900d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be900d2 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.011940:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664393.011990:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+16:3309:x1875550222244864:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664393.011996:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664393.012011:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788664393.012018:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+15:3307:x1875550222245248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664393.012025:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664393.012034:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66eee00/0x762f55027be903db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be903d4 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664393.012043:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664393.012074:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25199117-f21d-4733-8eaf-e8fb9fef1d54+14:3307:x1875550222245248:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664393.012080:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788664393.012113:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244736 00000100:00100000:0.0:1788664393.012119:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244736 00000100:00100000:0.0:1788664393.012165:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788664393.012171:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875550222244736:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788664393.012196:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be9001c 00000100:00080000:0.0:1788664393.012216:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b68f808f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664393.012265:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788664393.012632:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3306:x1875550222244736:12345-0@lo:9:umount.0 Request processed in 460us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664393.012639:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788664393.013276:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788664393.013830:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664393.013936:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222245248:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788664393.016026:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f808b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788664393.016044:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788664393.016046:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788664393.016052:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222244736:0@lo:9:umount.0 00000100:00100000:3.0:1788664393.016094:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222244864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664393.016105:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f8f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222244608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664393.016261:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222244992 00000100:00100000:0.0:1788664393.016270:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222244992 00000100:00100000:0.0:1788664393.016337:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788664393.016362:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875550222244992:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788664393.016529:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90103 00000100:00080000:0.0:1788664393.016540:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b68f85db800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788664393.016580:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788664393.016794:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3306:x1875550222244992:12345-0@lo:9:umount.0 Request processed in 433us (3517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664393.016804:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:0.0:1788664393.016827:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788664393.016835:0:5851:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788664393.016846:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788664393.016866:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68fb58b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788664393.016878:0:3306:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788664393.016880:0:3306:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788664393.016883:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222244992:0@lo:9:umount.0 00000020:00080000:0.0:1788664393.025007:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9b68c9200000) has no exports 00000020:00000080:0.0:1788664393.168258:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fee1 00000020:00000080:0.0:1788664393.168273:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f8ff2800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788664393.168297:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788664393.168387:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664393.168399:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788664393.168404:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9b68f8fe99c0) has no exports 00000020:00000080:2.0:1788664393.169820:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f8ff2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788664393.170488:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8feda 00000020:00000080:1.0:1788664393.170499:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68defbf000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788664393.170562:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664393.170572:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788664393.170575:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f7d66000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788664393.170578:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f7d66000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788664393.170588:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788664393.171312:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68defbf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788664393.171510:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68c9362120 - data ffff9b6901e806c0/ffff9b68fb7f5800 00000020:01000000:1.0:1788664393.171712:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68c8086780 - data ffff9b68f1c21948/ffff9b68fb389800 00000001:00000004:1.0:1788664393.185526:0:12981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788664393.244121:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788664393.244131:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788664393.244167:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664393.244169:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788664393.244844:0:6970:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788664393.244850:0:6970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788664393.244862:0:6970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788664393.246047:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788664393.246052:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788664393.246072:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664393.246075:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788664393.246301:0:7959:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788664393.246305:0:7959:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788664393.246320:0:7959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788664393.298390:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fea9 00000020:00000080:2.0:1788664393.298403:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f9104800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788664393.299684:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8febe 00000020:00000080:2.0:1788664393.299692:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f9106000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788664393.299699:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788664393.299704:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664393.299711:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788664393.299715:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9b68c9204d40) has no exports 00000004:01000000:2.0:1788664393.299867:0:12981:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788664393.299889:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be900fc 00000020:00000080:2.0:1788664393.299894:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f85de000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788664393.299898:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788664393.299902:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664393.299908:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788664393.299911:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9b68f8188000) has no exports 00000020:00000080:2.0:1788664393.299917:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be900f5 00000020:00000080:2.0:1788664393.299920:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68def86000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788664393.300235:0:12981:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788664393.300240:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788664393.300252:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788664393.300258:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664393.300260:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788664393.300292:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664393.300300:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664393.300305:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90015 00000020:00000080:2.0:1788664393.300309:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68fb58f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788664393.300313:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788664393.300316:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664393.300320:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788664393.300322:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9b68f818cd40) has no exports 00000020:00000080:2.0:1788664393.300326:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be9000e 00000020:00000080:2.0:1788664393.300329:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f808a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788664393.302614:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f9104800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788664393.302637:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f9106000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788664393.302643:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f85de000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788664393.302664:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68def86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788664393.302669:0:12947:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68fb58b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788664393.302678:0:12947:0:(genops.c:885:class_export_put()) final put ffff9b68f85c1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788664393.302681:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f85c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788664393.302686:0:12947:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788664393.302756:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68fb58f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788664393.302761:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f808a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788664393.304987:0:12981:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788664393.304995:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788664393.304999:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788664393.305006:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788664393.305008:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788664393.305062:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664393.305074:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664393.305105:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664393.305107:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664393.305112:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68def84800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664393.305116:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68def84800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788664393.305123:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788664393.305274:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fec5 00000020:00000080:2.0:1788664393.305281:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f9107800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788664393.305285:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788664393.305869:0:12947:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f808b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788664393.305878:0:12947:0:(genops.c:885:class_export_put()) final put ffff9b68df62a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788664393.305881:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68df62a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788664393.305886:0:12947:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788664393.305966:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f9107800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788664393.307802:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664393.307816:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788664393.307820:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9b68c9203380) has no exports 00000020:00000080:2.0:1788664393.307855:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664393.307872:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788664393.307875:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f9105800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788664393.307878:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f9105800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788664393.307882:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788664393.308058:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fecc 00000020:00000080:2.0:1788664393.308064:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f9102800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788664393.308117:0:12981:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68d438d000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788664393.308120:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68d438d000 3 00000020:01000004:2.0:1788664393.308122:0:12981:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b68d438d000 from lustre-MDT0000 00000020:00000080:2.0:1788664393.308137:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664393.308149:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788664393.308152:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f9101000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788664393.308154:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f9101000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788664393.308160:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788664393.308189:0:12981:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788664393.308192:0:12981:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788664393.308196:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788664393.308201:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664393.308203:0:12981:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788664393.308209:0:12981:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9b68c58c5000 25199117-f21d-4733-8eaf-e8fb9fef1d54 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788664393.308215:0:12981:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9b68c92019c0) has exports, disconnecting them 00000020:00080000:2.0:1788664393.308219:0:12981:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b68c58c5000), last request at 1788664149 00000020:00000080:2.0:1788664393.308232:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fe6a 00000020:00010000:2.0:1788664393.308236:0:12981:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9b68c58c5000: total 1 00000100:00080000:2.0:1788664393.308240:0:12981:0:(import.c:65:import_set_state_nolock()) ffff9b68c58c2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788664393.308267:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b68c58c5000): rc 0 00000020:00080000:2.0:1788664393.308271:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9b68c92019c0) has no exports 00000020:00010000:1.0:1788664393.308490:0:6710:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9b68c58c5000: total 1 00010000:00010000:1.0:1788664393.308522:0:6710:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b68c58c5000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788664393.308551:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1478400/0x762f55027be8ff82 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be8ff7b expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308573:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512aa00/0x762f55027be901c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be901b9 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308585:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ee400/0x762f55027be903bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be903b8 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308596:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c147b800/0x762f55027be903cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be903c6 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308610:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479000/0x762f55027be9016c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be90165 expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308622:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66eea00/0x762f55027be9017a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be90173 expref: 4 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308632:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512bc00/0x762f55027be90196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be9018f expref: 3 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308655:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c1479c00/0x762f55027be90188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x762f55027be90181 expref: 2 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664393.308667:0:6710:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b68c58c5000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788664393.308679:0:6710:0:(genops.c:885:class_export_put()) final put ffff9b68c58c5000/25199117-f21d-4733-8eaf-e8fb9fef1d54 00000020:00000080:0.0:1788664393.310566:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f9102800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788664393.310706:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664393.310709:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664393.310711:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664393.310755:0:5847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b68c705d000:5847] 0 exiting: rc = 1 00000020:00000080:0.0:1788664393.310901:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68c58c5000/25199117-f21d-4733-8eaf-e8fb9fef1d54 for MGS 00000020:00000080:0.0:1788664393.310932:0:12947:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68c58c2000 for MGS 00000100:00100000:0.0:1788664393.311522:0:5849:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b68d1a71800:5849] 2 exiting: rc = 0 00000100:00100000:0.0:1788664393.315531:0:5848:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b68c705d800:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1788664393.315735:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315743:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315749:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315754:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315760:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315779:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315785:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315790:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315797:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315803:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315809:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315815:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315822:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315828:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315833:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315840:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315846:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315852:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315857:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315863:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315867:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315872:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315877:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315882:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315890:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315895:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315901:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315907:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315913:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315919:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315924:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315929:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315935:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315941:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315946:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315952:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315957:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315962:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315968:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315973:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315986:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315991:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.315996:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316002:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316007:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316012:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316018:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316023:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316027:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316033:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316038:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316042:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316047:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316052:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316056:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316060:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316065:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316069:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316074:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316080:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316085:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316090:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316095:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664393.316100:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788664393.316507:0:12981:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788664393.316511:0:12981:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788664393.324182:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68d43ff180 - data ffff9b6901ee9d80/ffff9b67c4b74400 00000020:01000000:2.0:1788664393.324373:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68c7d75240 - data ffff9b68c21380d8/ffff9b68c349f400 00000020:00000080:2.0:1788664393.324869:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fe4e 00000020:00000080:2.0:1788664393.324877:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68d438f800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788664393.324898:0:12981:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68d438d000 from MGS, refs=2 00000020:01000004:2.0:1788664393.324901:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68d438d000 2 00000020:01000004:2.0:1788664393.324904:0:12981:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b68d438d000 from MGS 00000020:00000080:2.0:1788664393.324927:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664393.324946:0:12981:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788664393.324949:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68d438c000/MGS 00000020:00000080:2.0:1788664393.324952:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68d438c000/MGS for MGS 00000020:01000000:2.0:1788664393.324958:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788664393.325018:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788664393.325022:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664393.325028:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788664393.325034:0:12981:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b68f8ff7800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788664393.325040:0:12981:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9b68f8fecd40) has exports, disconnecting them 00000020:00080000:2.0:1788664393.325044:0:12981:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b68f8ff7800), last request at 1788664150 00000020:00000080:2.0:1788664393.325048:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8ff19 00000020:00080000:2.0:1788664393.325058:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b68f8ff7800): rc 0 00000020:00000080:2.0:1788664393.325063:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68f8ff7800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788664393.325732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68d438f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788664393.325746:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f8ff7800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788664393.328743:0:12981:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788664393.328754:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664393.328759:0:12981:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788664393.328767:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788664393.328970:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664393.328980:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788664393.328988:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68d438d000 1 00000020:00000080:0.0:1788664393.328995:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fe40 00000020:00000080:0.0:1788664393.329023:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68d4389000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788664393.329028:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788664393.329034:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664393.329037:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788664393.329041:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9b68c8fe4d40) has no exports 00000020:00000080:1.0:1788664393.329268:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f7d61000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788664393.329275:0:37:0:(genops.c:885:class_export_put()) final put ffff9b68f8ff0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788664393.329278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f8ff0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788664393.329284:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788664393.329372:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68d4389000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788664393.400039:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664393.400057:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788664393.400063:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68e6673000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788664393.400068:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68e6673000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788664393.400075:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788664393.400219:0:12981:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b68d4388800 00000020:01000000:1.0:1788664393.400240:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788664393.400244:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664393.400249:0:12981:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788664393.400253:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9b68c3f94d40) has no exports 00000100:00100000:1.0:1788664393.400360:0:7653:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b68f85d2000:7653] 3 exiting: rc = 0 00000100:00100000:2.0:1788664393.402737:0:5855:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b68c9211000:5855] 1 exiting: rc = 0 00000100:00100000:3.0:1788664393.410878:0:5856:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b68c9211800:5856] 2 exiting: rc = 0 00000100:00100000:3.0:1788664393.410996:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b68c9211600:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1788664393.412396:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412404:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412410:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412417:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412434:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412440:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412446:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412452:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412458:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412463:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412469:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412474:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412480:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412485:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412491:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412497:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412503:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412510:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412516:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412523:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412528:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412534:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412539:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412545:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412550:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412557:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412564:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412570:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412576:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412581:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412587:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412593:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412600:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412606:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412613:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412619:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412626:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412631:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412636:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412650:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412656:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412662:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412668:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412673:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412679:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412685:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412691:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412696:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412702:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412708:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412714:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412720:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412725:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412731:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412737:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412742:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412748:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412753:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412759:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412764:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412769:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412774:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412780:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.412786:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.427826:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b68c9210800:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1788664393.432466:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b68c5875600:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1788664393.432585:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432594:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432601:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432608:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432615:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432622:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432628:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432633:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432639:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432645:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432651:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432658:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432665:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432670:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432676:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432681:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432686:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432691:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432698:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432703:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432708:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432714:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432719:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432723:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432728:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432733:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432738:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432757:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432762:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432767:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432772:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432777:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432782:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432788:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432794:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432799:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432803:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432808:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432814:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432819:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432825:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432831:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432837:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432843:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432849:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432855:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432860:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432866:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432872:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432892:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432898:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432903:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432908:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432913:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432918:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432924:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432929:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432934:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432940:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432945:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432952:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432958:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432972:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.432977:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433459:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b68c3fd4600:5860] 1 exiting: rc = 0 00000100:00100000:0.0:1788664393.433520:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b68c9211400:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1788664393.433572:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433580:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433587:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433592:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433599:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433605:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433612:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433618:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433624:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433631:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433637:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433644:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433666:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433674:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433680:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433686:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433693:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433700:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433706:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433713:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433720:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433727:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433734:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433740:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433762:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433769:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433775:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433781:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433787:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433792:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433799:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433814:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433821:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433827:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433834:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433840:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433861:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433869:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433877:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433884:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433891:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433897:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433905:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433911:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433919:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433926:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433932:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433939:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433957:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433964:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433970:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433978:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433985:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433993:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.433999:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434006:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434015:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434021:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434028:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434034:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434055:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434063:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434069:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.434076:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.444507:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b68c3fd5600:5861] 0 exiting: rc = 1 00000100:00100000:3.0:1788664393.444807:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b68c3fd5000:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1788664393.444975:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.444981:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.444988:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.444993:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.444998:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445003:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445008:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445013:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445019:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445024:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445041:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445046:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445052:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445057:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445062:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445067:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445072:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445077:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445082:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445088:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445093:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445098:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445114:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445120:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445125:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445130:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445136:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445141:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445146:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445151:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445155:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445161:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445166:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445171:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445176:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445180:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445185:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445190:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445197:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445202:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445207:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445212:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445216:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445221:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445226:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445239:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445246:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445250:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445268:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445273:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445278:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445291:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445297:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445302:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445307:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445312:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445317:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445322:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445327:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445332:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445337:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445380:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445386:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445391:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.445713:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b68c3fd4200:5864] 1 exiting: rc = 0 00000100:00100000:2.0:1788664393.446845:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b68c3fd4000:5863] 0 exiting: rc = 1 00000100:00100000:1.0:1788664393.448623:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448632:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448638:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448643:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448648:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448654:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448659:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448664:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448669:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448676:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448683:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448688:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448693:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448699:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448704:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448721:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448727:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448732:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448737:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448742:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448746:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448751:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448756:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448761:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448766:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448771:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448776:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448781:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448786:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448791:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448797:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448802:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448807:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448812:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448817:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448822:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448827:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448832:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448837:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448842:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448848:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448853:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448858:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448863:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.448868:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449749:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449756:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449761:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449766:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449771:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449786:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449791:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449796:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449801:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449805:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449810:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449816:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449821:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449825:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449830:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449836:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449841:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449845:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.449850:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.455637:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b68c3fd5c00:5866] 1 exiting: rc = 0 00000100:00100000:3.0:1788664393.455931:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b68c3fd4e00:5865] 0 exiting: rc = 1 00000100:00100000:1.0:1788664393.456422:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456430:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456436:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456441:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456446:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456452:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456457:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456461:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456467:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456471:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456477:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456481:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456486:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456492:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456498:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456503:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456508:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456513:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456519:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456524:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456529:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456545:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456550:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456554:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456560:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456565:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456571:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456576:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456581:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456587:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456592:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456597:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456602:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456607:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456612:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456617:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456622:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456628:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456633:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456638:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456643:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456649:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456654:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456659:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456664:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456670:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456675:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456680:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456685:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456690:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456695:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456701:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456706:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456711:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456716:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456722:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456734:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456739:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456744:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456749:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456753:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456757:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456762:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.456767:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664393.457559:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b68c34b5200:5867] 0 exiting: rc = 1 00000100:00100000:2.0:1788664393.461659:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b68c3fd5a00:5868] 1 exiting: rc = 0 00000100:00100000:3.0:1788664393.462174:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b68c3fd8600:5869] 2 exiting: rc = 0 00000100:00100000:1.0:1788664393.466458:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466469:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466476:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466482:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466486:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466491:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466497:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466502:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466508:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466514:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466520:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466525:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466530:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466535:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466541:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466546:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466552:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466558:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466564:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466569:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466575:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466580:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466585:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466591:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466612:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466619:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466624:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466642:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466647:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466653:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466660:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466665:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466670:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466676:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466682:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466687:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466692:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466698:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466705:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466710:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466718:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466724:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466731:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466736:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466742:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466748:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466753:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466760:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466780:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466787:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466793:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466799:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466804:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466810:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466816:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466821:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466827:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466832:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466838:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466843:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466849:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466855:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466937:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664393.466945:0:12981:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788664393.477642:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664393.477656:0:12981:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788664393.477663:0:12981:0:(genops.c:885:class_export_put()) final put ffff9b68c9393000/MDS_uuid 00000020:00000080:1.0:1788664393.477668:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68c9393000/MDS_uuid for MDS 00000020:01000000:1.0:1788664393.477678:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788664393.477797:0:12981:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788664393.543732:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788664393.602937:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788664393.602949:0:7657:0:(genops.c:885:class_export_put()) final put ffff9b68f85d8000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788664393.602975:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:1.0:1788664393.602978:0:7657:0:(genops.c:885:class_export_put()) final put ffff9b68dff25000/5e600724-38bd-4119-be7d-5264f08f0aa5 00000020:00000080:0.0:1788664393.603084:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f85d8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788664393.603143:0:12947:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68dff25000/5e600724-38bd-4119-be7d-5264f08f0aa5 for lustre-OST0001 00000020:00000080:0.0:1788664393.603163:0:12947:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f85db800 for lustre-OST0001 00000020:00000080:0.0:1788664393.603167:0:12947:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68dff22000 for lustre-OST0001 00010000:00010000:1.0:1788664394.610414:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664395.553191:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222245376:0@lo:400:kworker.0 00000400:00000100:3.0:1788664395.553249:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875550222245376 offset 0 length 224: 4 00000100:00100000:3.0:1788664395.553569:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664395.553576:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222245504:0@lo:400:kworker.0 00000400:00000100:3.0:1788664395.553602:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550222245504 offset 0 length 224: 4 00000100:00100000:0.0:1788664395.554054:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222245632:0@lo:400:kworker.0 00000400:00000100:0.0:1788664395.554080:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550222245632 offset 0 length 224: 4 00010000:00010000:1.0:1788664395.616565:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788664396.133317:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788664396.133333:0:6723:0:(genops.c:885:class_export_put()) final put ffff9b68f808a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788664396.133398:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f808a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788664396.133450:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f808f800 for lustre-OST0000 00010000:00010000:0.0:1788664396.643579:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664396.877556:0:13132:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:3.0:1788664396.884000:0:13132:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788664396.884184:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664396.884199:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664396.884206:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664396.884213:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664396.884236:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788664396.884242:0:13132:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788664396.884264:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788664396.884289:0:13132:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b68e7ed9500 x1875550222245504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664411 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664396.884327:0:13132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788664396.884333:0:13132:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788664396.884579:0:13132:0:(import.c:65:import_set_state_nolock()) ffff9b67c536e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788664396.884618:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875550222245760:0@lo:39:umount.0 00000400:00000100:0.0:1788664396.884685:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550222245760 offset 0 length 224: 4 00010000:00010000:1.0:1788664396.885123:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664396.885132:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664396.885140:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512be00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1788664396.885143:0:5843:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664396.885151:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788664396.885169:0:5843:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664396.885175:0:5843:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788664396.885178:0:5843:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788664396.885181:0:5843:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788664396.885208:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664396.885227:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788664396.885262:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664396.885270:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c512be00/0x762f55027be90181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x762f55027be90188 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664396.885282:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664396.885284:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664396.885285:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664396.885309:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222245504:0@lo:400:kworker.0 00000100:00100000:3.0:1788664396.885438:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664396.885449:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222245888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664396.885493:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664396.886982:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222245888 00000100:00100000:1.0:1788664396.886996:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222245888 00000100:00100000:1.0:1788664396.887046:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788664396.887055:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1875550222245888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788664396.887063:0:5840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788664396 with bad export cookie 8516118889538059882 00000100:00100000:2.0:1788664396.894972:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1875550222245888:12345-0@lo:103:ldlm_bl.0 Request processed in 7904us (9466us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788664396.894989:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788664396.895068:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788664396.895074:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b68c9397800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788664396.895093:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788664396.907180:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.114@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788664396.907185:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788664396.907194:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b68e7ed8380 x1875550222245376/t0(0) o400->MGC192.168.202.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788664411 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664396.907271:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b67c722df80 x1875550222245888/t0(0) o103->MGC192.168.202.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788664412 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788664396.907279:0:3307:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788664396.907281:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788664396.907282:0:3307:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788664396.907285:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b68c9397800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664396.907288:0:3307:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 183 00000100:00080000:3.0:1788664396.907296:0:3307:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import ffff9b68c9397800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664396.907335:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68e7ede300 x1875550222246016/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788664396.907401:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25199117-f21d-4733-8eaf-e8fb9fef1d54:3307:1875550222245888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664396.907496:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25199117-f21d-4733-8eaf-e8fb9fef1d54:3306:1875550222246016:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788664396.907546:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875550222246016 offset 0 length 520: 4 00000100:00100000:1.0:1788664396.909420:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25199117-f21d-4733-8eaf-e8fb9fef1d54:3309:1875550222245376:0@lo:400:kworker.0 00010000:00010000:1.0:1788664397.671182:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664398.687797:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664399.711988:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664400.672472:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664400.672488:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788664400.672661:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788664400.672691:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222246144:0@lo:400:kworker.0 00000400:00000100:2.0:1788664400.672782:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550222246144 offset 0 length 224: 4 00010000:00010000:1.0:1788664400.737801:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664401.695940:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664401.695957:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788664401.697484:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664401.697521:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222246272:0@lo:400:kworker.0 00000400:00000100:1.0:1788664401.697600:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550222246272 offset 0 length 224: 4 00010000:00010000:0.0:1788664401.759835:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664402.783895:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664403.807899:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664404.839425:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664405.855520:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664406.303951:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664396/real 1788664396] req@ffff9b68e7ede300 x1875550222246016/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788664406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664406.303997:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b68e7ede300 x1875550222246016/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788664406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664406.304009:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664396/real 1788664396] req@ffff9b68e7edd880 x1875550222245760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664406 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664406.304023:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b68e7edd880 x1875550222245760/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664406 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788664406.304048:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68c9397800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664406.304086:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788664406.304091:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25199117-f21d-4733-8eaf-e8fb9fef1d54:3306:1875550222246016:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788664406.304125:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b67c536e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788664406.304147:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788664406.304151:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875550222245760:0@lo:39:umount.0 00000100:00080000:3.0:1788664406.304154:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788664406.304158:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b68c9397800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664406.304163:0:38:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1788664406.304170:0:38:0:(import.c:630:import_select_connection()) MGC192.168.202.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788664406.304178:0:38:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import ffff9b68c9397800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664406.304235:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68e7eddf80 x1875550222246400/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788664406.304319:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664406.304334:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222246528:0@lo:400:kworker.0 00000400:00000100:3.0:1788664406.304422:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550222246528 offset 0 length 224: 4 00000100:00100000:0.0:1788664406.304473:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25199117-f21d-4733-8eaf-e8fb9fef1d54:3306:1875550222246400:0@lo:250:kworker.0 00000400:00000100:0.0:1788664406.304507:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875550222246400 offset 0 length 520: 4 00000100:00080000:1.0:1788664406.310077:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788664406.310091:0:13132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788664406.310105:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788664406.315011:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315036:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315043:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315586:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315628:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664406.315638:0:13132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315646:0:13132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315653:0:13132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315660:0:13132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664406.315796:0:13132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788664406.315802:0:13132:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788664406.315850:0:13132:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788664406.315855:0:13132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788664406.315862:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664406.315869:0:13132:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788664406.315875:0:13132:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b68c8fe3380) has no exports 00000020:00080000:1.0:1788664406.316018:0:13132:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9b68c8fe3380) has no exports 00010000:00010000:0.0:1788664406.320534:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664406.320555:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320580:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c1478e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664406.320586:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320599:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664406.320607:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664406.320614:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788664406.320617:0:5844:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788664406.320621:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788664406.320649:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b68c9397800 00010000:00010000:0.0:1788664406.320653:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320660:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c1478e00/0x762f55027be9018f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be90196 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320718:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664406.320722:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320727:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664406.320730:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320737:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664406.320743:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664406.320748:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788664406.320751:0:5844:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788664406.320753:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788664406.320759:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b68c9397800 00010000:00010000:0.0:1788664406.320762:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320769:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea400/0x762f55027be903c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be903cd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664406.320778:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664406.320780:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664406.320782:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788664406.323513:0:13132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68c93627e0 - data ffff9b68d1033e58/ffff9b68fb7f6c00 00000020:01000000:1.0:1788664406.323679:0:13132:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68c8026720 - data ffff9b68f1eb9bd0/ffff9b67c502c400 00010000:00010000:2.0:1788664406.333179:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788664406.349003:0:13132:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788664406.387254:0:13132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8ff9e 00000020:00000080:2.0:1788664406.387699:0:13132:0:(genops.c:885:class_export_put()) final put ffff9b67c510e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788664406.387834:0:13132:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68f8b62000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788664406.387840:0:13132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68f8b62000 2 00000020:01000004:2.0:1788664406.387844:0:13132:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b68f8b62000 from lustre-OST0000 00000020:00000080:2.0:1788664406.387881:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664406.387895:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788664406.387899:0:13132:0:(genops.c:885:class_export_put()) final put ffff9b68fb58b000/lustre-OST0000_UUID 00000020:00000080:2.0:1788664406.387902:0:13132:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68fb58b000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788664406.387911:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788664406.387981:0:13132:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788664406.387987:0:13132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788664406.387993:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664406.387999:0:13132:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788664406.388008:0:13132:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b68c9390000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788664406.388015:0:13132:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9b68c3f90000) has exports, disconnecting them 00000020:00080000:2.0:1788664406.388022:0:13132:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b68c9390000), last request at 1788664167 00000020:00000080:2.0:1788664406.388026:0:13132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8ffc8 00000020:00080000:2.0:1788664406.388047:0:13132:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b68c9390000): rc 0 00000020:00000080:2.0:1788664406.388053:0:13132:0:(genops.c:885:class_export_put()) final put ffff9b68c9390000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788664406.390443:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b67c510e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788664406.394378:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68c9390000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788664406.398675:0:13132:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788664406.398711:0:13132:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664406.398716:0:13132:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788664406.398726:0:13132:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788664406.398960:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788664406.398972:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788664406.398981:0:13132:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68f8b62000 1 00000020:00000080:0.0:1788664406.398990:0:13132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8ff58 00000020:00000080:0.0:1788664406.399001:0:13132:0:(genops.c:885:class_export_put()) final put ffff9b68fb58d000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788664406.399008:0:13132:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788664406.399013:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788664406.399019:0:13132:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788664406.399023:0:13132:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9b68f8fe8000) has no exports 00000020:00000080:1.0:1788664406.399136:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b67c536e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788664406.399145:0:38:0:(genops.c:885:class_export_put()) final put ffff9b67c536e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788664406.399148:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b67c536e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788664406.399156:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788664406.399227:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68fb58d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788664406.430967:0:13132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664406.430993:0:13132:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788664406.431000:0:13132:0:(genops.c:885:class_export_put()) final put ffff9b68f8b60000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788664406.431006:0:13132:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f8b60000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788664406.431029:0:13132:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788664406.434023:0:13132:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b68f8b66000 00000020:02000400:1.0:1788664406.434109:0:13132:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788664406.880745:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664407.906657:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664408.930751:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664409.938416:0:13284:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00010000:00010000:2.0:1788664409.954242:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788664409.956628:0:13284:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788664409.956760:0:13284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664409.956776:0:13284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664409.956784:0:13284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664409.956792:0:13284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664409.956854:0:13284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788664409.956861:0:13284:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788664409.956884:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788664409.956898:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b68e7edad80 x1875550222245632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664411 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664409.956922:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b68e7eddc00 x1875550222246144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664416 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664409.956948:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b68e7edf480 x1875550222246272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664417 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664409.956986:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b68e7edf800 x1875550222246528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664422 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664409.957000:0:13284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1788664409.957032:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3308:1875550222246528:0@lo:400:kworker.0 00000100:00080000:3.0:1788664409.957060:0:13284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788664409.957085:0:13284:0:(import.c:65:import_set_state_nolock()) ffff9b68f85df800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788664409.957206:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222245632:0@lo:400:kworker.0 00000100:00100000:1.0:1788664409.957290:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3310:1875550222246144:0@lo:400:kworker.0 00000100:00100000:1.0:1788664409.957317:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222246272:0@lo:400:kworker.0 00000100:00100000:1.0:1788664409.957503:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875550222246656:0@lo:39:umount.0 00000400:00000100:1.0:1788664409.957553:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875550222246656 offset 0 length 224: 4 00010000:00010000:0.0:1788664409.957876:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664409.957886:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664409.957896:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664409.957901:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664409.957911:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664409.957919:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664409.957926:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788664409.957929:0:5844:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788664409.957932:0:5844:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788664409.957949:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b68c9397800 00010000:00010000:0.0:1788664409.958028:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664409.958046:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c512a800/0x762f55027be90165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be9016c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664409.958059:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664409.958061:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664409.958063:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664410.980383:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664411.424033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788664411.424041:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788664411.999557:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664413.023771:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664414.050552:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664415.075674:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664416.095620:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664416.543617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788664416.543629:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788664417.119714:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664418.143446:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664419.167887:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664409/real 1788664409] req@ffff9b68e7edf800 x1875550222246656/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664419 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664419.167939:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b68e7edf800 x1875550222246656/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788664419 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788664419.167959:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f85df800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788664419.167989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875550222246656:0@lo:39:umount.0 00000100:00080000:3.0:1788664419.168051:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788664419.168057:0:13284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788664419.168062:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788664419.169458:0:13284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.169476:0:13284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.169485:0:13284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.169493:0:13284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.169625:0:13284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664419.169934:0:13284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.170086:0:13284:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.170096:0:13284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664419.170103:0:13284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171240:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664419.171250:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171259:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ac00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664419.171263:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171272:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664419.171279:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664419.171284:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788664419.171286:0:5844:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788664419.171298:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b68c9397800 00010000:00010000:0.0:1788664419.171301:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171324:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c512ac00/0x762f55027be90173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be9017a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171734:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664419.171742:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171749:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664419.171753:0:5844:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171759:0:5844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664419.171765:0:5844:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664419.171770:0:5844:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788664419.171772:0:5844:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788664419.171778:0:5844:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b68c9397800 00010000:00010000:0.0:1788664419.171781:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664419.171789:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664419.171790:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664419.171793:0:5844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664419.180327:0:13284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788664419.180445:0:6710:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664419.180488:0:13284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb800/0x762f55027be903b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be903bf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664419.180583:0:13284:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788664419.180593:0:13284:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788664419.180596:0:13284:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788664419.180625:0:13284:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788664419.180630:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788664419.180639:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788664419.180644:0:13284:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788664419.180649:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b68e7e63380) has no exports 00000020:00080000:3.0:1788664419.180674:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9b68e7e63380) has no exports 00010000:00010000:2.0:1788664419.182769:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788664419.191137:0:13284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68d43ffc60 - data ffff9b6901ee9288/ffff9b67c4b76800 00000020:01000000:3.0:1788664419.192831:0:13284:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9b68c9362060 - data ffff9b68ea799ca8/ffff9b68d433dc00 00100000:10000000:3.0:1788664419.210034:0:13284:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788664419.239628:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90069 00000020:00000080:2.0:1788664419.239651:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b67c510a000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788664419.239661:0:13284:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68c343c800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788664419.239665:0:13284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68c343c800 2 00000020:01000004:2.0:1788664419.239668:0:13284:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b68c343c800 from lustre-OST0001 00000020:00000080:2.0:1788664419.239694:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664419.239705:0:13284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788664419.239707:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b67c5108800/lustre-OST0001_UUID 00000020:00000080:2.0:1788664419.239710:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff9b67c5108800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788664419.239717:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788664419.239816:0:13284:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 25199117-f21d-4733-8eaf-e8fb9fef1d54->MGS 00010000:00010000:2.0:1788664419.239832:0:13284:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be8ff82 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664419.239844:0:13284:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be8ff82 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664419.239851:0:13284:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788664419.239854:0:13284:0:(mgc_request.c:952:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788664419.239857:0:13284:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788664419.239871:0:13284:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b68c9397800 00010000:00010000:2.0:1788664419.239874:0:13284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66eec00/0x762f55027be8ff7b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be8ff82 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664419.239889:0:13284:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x762f55027be901c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664419.239896:0:13284:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x762f55027be901c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664419.239902:0:13284:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788664419.239904:0:13284:0:(mgc_request.c:952:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788664419.239906:0:13284:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788664419.239924:0:13284:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b68c9397800 00010000:00010000:2.0:1788664419.239927:0:13284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee800/0x762f55027be901b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x762f55027be901c0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788664419.239945:0:13284:0:(import.c:65:import_set_state_nolock()) ffff9b68c9397800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788664419.239949:0:13284:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788664419.239952:0:13284:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788664419.239953:0:13284:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788664419.239957:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788664419.239967:0:13284:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b68e7eddf80 x1875550222246400/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788664421 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788664419.239984:0:13284:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788664419.239987:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788664419.240168:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25199117-f21d-4733-8eaf-e8fb9fef1d54:3306:1875550222246400:0@lo:250:kworker.0 10000000:01000000:2.0:1788664419.240232:0:13284:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788664419.240240:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be8fe5c 00000020:00000080:2.0:1788664419.240244:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b68c9392800/25199117-f21d-4733-8eaf-e8fb9fef1d54 00000020:01000000:2.0:1788664419.240250:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.114@tcp (flags='') 00000020:00000080:2.0:1788664419.240255:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664419.240407:0:13284:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788664419.240413:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9b68c3f919c0) has no exports 00000020:00000080:0.0:1788664419.240623:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b67c510a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788664419.240635:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68c9392800/25199117-f21d-4733-8eaf-e8fb9fef1d54 for MGC192.168.202.114@tcp 10000000:01000000:1.0:1788664419.245297:0:5852:0:(mgc_request.c:706:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788664419.245493:0:13284:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.114@tcp: client import never connected 00000100:00080000:2.0:1788664419.245499:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788664419.245503:0:13284:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788664419.245507:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788664419.245519:0:13284:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788664419.245575:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788664419.245584:0:13284:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.114@tcp (uuid 25199117-f21d-4733-8eaf-e8fb9fef1d54) 00000020:01000000:2.0:1788664419.245591:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788664419.245596:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788664419.245601:0:13284:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788664419.245609:0:13284:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b68f85d9000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788664419.245615:0:13284:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9b68f8feb380) has exports, disconnecting them 00000020:00080000:2.0:1788664419.245630:0:13284:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b68f85d9000), last request at 1788664188 00000020:00000080:2.0:1788664419.245635:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90093 00000020:00080000:2.0:1788664419.245650:0:13284:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b68f85d9000): rc 0 00000020:00000080:2.0:1788664419.245655:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b68f85d9000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788664419.246375:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68c9397800 for MGC192.168.202.114@tcp 00000020:00000080:0.0:1788664419.246385:0:38:0:(genops.c:885:class_export_put()) final put ffff9b68c9392000/25199117-f21d-4733-8eaf-e8fb9fef1d54 00000020:00000080:0.0:1788664419.246388:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68c9392000/25199117-f21d-4733-8eaf-e8fb9fef1d54 for MGC192.168.202.114@tcp 00000020:01000000:0.0:1788664419.246395:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.114@tcp (25199117-f21d-4733-8eaf-e8fb9fef1d54) 00000020:00000080:0.0:1788664419.246619:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f85d9000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788664419.258449:0:13284:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788664419.258457:0:13284:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788664419.258462:0:13284:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788664419.258468:0:13284:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788664419.258542:0:5844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788664419.258651:0:6710:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788664419.258714:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788664419.258830:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b68cb955800:5839] 1 exiting: rc = 0 00000020:00000080:1.0:1788664419.258882:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9b68f85df800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1788664419.270574:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b68e48aca00:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1788664419.270730:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664419.271019:0:7644:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b68c3f8ce00:7644] 3 exiting: rc = 0 00000100:00100000:0.0:1788664419.271091:0:5841:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b68c2d68a00:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1788664419.271331:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b68d0373e00:5840] 0 exiting: rc = 1 00000100:00100000:3.0:1788664419.271868:0:5842:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b68c2d68400:5842] 2 exiting: rc = 0 00000100:00100000:1.0:1788664419.272140:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272213:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272220:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272226:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272232:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272237:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272242:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272248:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272253:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272620:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272630:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272636:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272642:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272648:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272655:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272660:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272667:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272672:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272677:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272682:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272699:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272704:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272710:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272715:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272720:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272725:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272730:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272735:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272740:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272745:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272750:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272755:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272760:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272765:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272769:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272776:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272781:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272787:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272792:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272797:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272802:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272806:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272812:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272817:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272822:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272827:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272832:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272837:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272842:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272847:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272851:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272856:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272860:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272864:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272869:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272881:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272886:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272891:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272896:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272901:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272906:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272911:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272916:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.272920:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788664419.274746:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664419.274757:0:13284:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788664419.274763:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b68fb249000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788664419.274767:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68fb249000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788664419.274773:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788664419.274816:0:13284:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68c343c800 1 00000020:00000080:1.0:1788664419.274822:0:13284:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x762f55027be90038 00000020:00000080:1.0:1788664419.274829:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b68c8646800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788664419.274853:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788664419.274857:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664419.274862:0:13284:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788664419.274866:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9b68c8fe19c0) has no exports 00000020:00000080:0.0:1788664419.274935:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68c8646800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788664419.289293:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664419.289307:0:13284:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788664419.289313:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b68f8b67000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788664419.289318:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68f8b67000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788664419.289326:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788664419.291489:0:13284:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b68c343c000 00000020:01000000:1.0:1788664419.291582:0:13284:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788664419.291588:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788664419.291594:0:13284:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788664419.291600:0:13284:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9b68c8fe0000) has no exports 00000020:00000080:1.0:1788664419.291646:0:13284:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788664419.291656:0:13284:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788664419.291668:0:13284:0:(genops.c:885:class_export_put()) final put ffff9b68fb589800/OSS_uuid 00000020:00000080:1.0:1788664419.291671:0:13284:0:(genops.c:844:class_export_destroy()) destroying export ffff9b68fb589800/OSS_uuid for OSS 00000020:01000000:1.0:1788664419.291679:0:13284:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788664419.291808:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b68c92d5e00:6696] 1 exiting: rc = 0 00000100:00100000:1.0:1788664419.291903:0:8476:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b68c59af200:8476] 3 exiting: rc = 0 00000100:00100000:3.0:1788664419.292038:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b68c92d4400:6694] 0 exiting: rc = 1 00000100:00100000:0.0:1788664419.292716:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b68c7efa600:6697] 2 exiting: rc = 0 00000100:00100000:0.0:1788664419.292777:0:12075:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9b68e11af200:12075] 4 exiting: rc = 0 00000100:00100000:1.0:1788664419.292921:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292932:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292938:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292945:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292952:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292957:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292962:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292966:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292972:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292978:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.292984:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293001:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293006:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293011:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293016:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293021:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293026:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293031:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293036:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293041:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293047:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293053:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293058:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293062:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293067:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293072:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293077:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293082:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293087:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293092:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293109:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293114:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293119:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293124:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293130:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293135:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293140:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293145:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293149:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293154:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293160:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293165:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293170:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293174:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293179:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293184:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293189:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293194:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293199:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293204:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293209:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293214:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293221:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293227:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293232:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293237:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293242:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293248:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293253:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293258:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293264:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293270:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293275:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788664419.293281:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:2.0:1788664419.294325:0:5851:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788664419.294924:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b68c7efa400:6698] 0 exiting: rc = 1 00000100:00100000:0.0:1788664419.294997:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b68d1aafc00:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1788664419.295089:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295096:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295102:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295107:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295113:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295118:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295123:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295129:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295134:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295150:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295156:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295161:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295167:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295172:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295178:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295183:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295189:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295194:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295199:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295205:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295210:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295216:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295222:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295227:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295233:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295238:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295242:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295248:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295268:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295273:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295279:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295284:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295289:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295294:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295299:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295304:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295309:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295325:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295331:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295336:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295373:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295380:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295385:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295389:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295394:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295399:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295404:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295409:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295413:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295418:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295422:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295428:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295433:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295439:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295444:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295449:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295455:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295461:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295466:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295471:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295477:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295482:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295487:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.295630:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788664419.296908:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b68d1aafa00:6700] 0 exiting: rc = 1 00000100:00100000:1.0:1788664419.297108:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b68d1aaf400:6701] 1 exiting: rc = 0 00000100:00100000:3.0:1788664419.297926:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b68d1aaee00:6702] 2 exiting: rc = 0 00000100:00100000:2.0:1788664419.298101:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298110:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298117:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298122:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298128:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298133:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298157:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298164:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298169:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298174:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298179:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298185:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298191:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298196:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298201:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298213:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298219:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298225:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298230:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298234:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298239:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298244:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298251:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298256:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298261:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298267:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298273:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298278:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298284:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298289:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298294:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298299:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298305:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298310:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298324:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298329:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298335:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298369:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298377:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298395:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298402:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298408:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298413:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298419:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298424:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298430:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298435:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298441:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298446:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298453:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298459:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298465:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298470:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298477:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298483:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298488:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298649:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298656:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298662:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298667:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298673:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298678:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298683:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.298688:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.305807:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b68d1aaf200:6703] 0 exiting: rc = 1 00000100:00100000:2.0:1788664419.305893:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b68d1aafe00:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1788664419.305957:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.305964:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.305970:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.305996:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306001:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306007:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306012:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306016:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306021:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306027:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306032:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306037:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306044:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306049:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306054:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306059:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306064:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306069:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306075:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306080:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306085:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306090:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306095:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306100:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306105:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306110:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306115:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306121:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306126:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306131:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306148:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306153:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306158:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306162:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306168:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306173:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306178:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306182:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306194:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306199:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306205:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306210:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306215:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306221:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306226:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306231:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306236:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306242:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306248:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306252:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306258:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306264:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306269:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306274:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306279:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306284:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306290:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306295:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306301:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306306:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306311:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306316:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306321:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.306326:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.307483:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b68c7efb800:6706] 1 exiting: rc = 0 00000100:00100000:1.0:1788664419.316451:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b68c7efa200:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1788664419.316943:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.316965:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.316974:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.316992:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317000:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317007:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317034:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317041:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317058:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317069:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317075:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317081:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317087:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317092:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317099:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317104:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317109:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317115:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317136:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317143:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317149:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317156:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317162:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317167:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317172:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317178:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317183:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317188:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317194:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317199:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317218:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317226:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317231:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317237:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317243:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317249:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317255:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317272:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317279:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317283:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317290:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317295:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317315:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317328:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317335:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317360:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317368:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317373:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317378:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317386:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317396:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317404:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317411:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317416:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317439:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317446:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317452:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317460:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317468:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317476:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.317482:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.318150:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.318164:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788664419.318171:0:13284:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788664419.344319:0:13284:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788664436.042113:0:13901:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788664450.811673:0:14363:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:3.0:1788664450.811678:0:14363:0:(obd_mount.c:924:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788664450.811814:0:14363:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b68dff20800 00000020:01000004:3.0:1788664450.811834:0:14363:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788664450.811844:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788664450.811864:0:14363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b68f8feb380) 00000020:00000080:3.0:1788664450.811879:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788664450.823875:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788664450.826236:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788664450.826986:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788664450.827223:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1788664450.827331:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788664450.827456:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788664450.827643:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788664450.827711:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1788664450.827861:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788664450.828181:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1788664450.835637:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 591: rc = 0 00100000:10000000:3.0:1788664450.835764:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 591: rc = 0 00100000:10000000:3.0:1788664450.836494:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 597: rc = 0 00100000:10000000:3.0:1788664450.836768:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 597: rc = 0 00100000:10000000:3.0:1788664450.837483:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 597: rc = 0 00100000:10000000:3.0:1788664450.837878:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 597: rc = 0 00100000:10000000:3.0:1788664450.838208:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 597: rc = 0 00100000:10000000:3.0:1788664450.838528:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 597: rc = 0 00100000:10000000:3.0:1788664450.838958:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 597: rc = 0 00100000:10000000:3.0:1788664450.839279:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 597: rc = 0 00100000:10000000:3.0:1788664450.839562:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 597: rc = 0 00100000:10000000:3.0:1788664450.839910:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 597: rc = 0 00100000:10000000:3.0:1788664450.840242:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 597: rc = 0 00100000:10000000:3.0:1788664450.840528:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 597: rc = 0 00100000:10000000:3.0:1788664450.840988:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 153: rc = 0 00100000:10000000:3.0:1788664450.841274:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 153: rc = 0 00100000:10000000:3.0:1788664450.841531:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 153: rc = 0 00100000:10000000:3.0:1788664450.842294:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 153: rc = 0 00100000:10000000:3.0:1788664450.842647:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 153: rc = 0 00100000:10000000:3.0:1788664450.842935:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 153: rc = 0 00100000:10000000:3.0:1788664450.843257:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 153: rc = 0 00100000:10000000:3.0:1788664450.843659:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 153: rc = 0 00100000:10000000:3.0:1788664450.843914:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 153: rc = 0 00100000:10000000:3.0:1788664450.844221:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 153: rc = 0 00100000:10000000:3.0:1788664450.844472:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 153: rc = 0 00100000:10000000:3.0:1788664450.844702:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 153: rc = 0 00100000:10000000:3.0:1788664450.844941:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 153: rc = 0 00100000:10000000:3.0:1788664450.845280:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 153: rc = 0 00100000:10000000:3.0:1788664450.845793:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 153: rc = 0 00100000:10000000:3.0:1788664450.846052:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 153: rc = 0 00100000:10000000:3.0:1788664450.846358:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 153: rc = 0 00100000:10000000:3.0:1788664450.846679:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 153: rc = 0 00100000:10000000:3.0:1788664450.846948:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 153: rc = 0 00100000:10000000:3.0:1788664450.847335:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 153: rc = 0 00100000:10000000:3.0:1788664450.847651:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 153: rc = 0 00100000:10000000:3.0:1788664450.847919:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 153: rc = 0 00100000:10000000:3.0:1788664450.848236:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 153: rc = 0 00100000:10000000:3.0:1788664450.848710:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 153: rc = 0 00100000:10000000:3.0:1788664450.848985:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 153: rc = 0 00100000:10000000:3.0:1788664450.849338:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 153: rc = 0 00100000:10000000:3.0:1788664450.849871:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 153: rc = 0 00100000:10000000:3.0:1788664450.850196:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 153: rc = 0 00100000:10000000:3.0:1788664450.850527:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 153: rc = 0 00100000:10000000:3.0:1788664450.850861:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 153: rc = 0 00100000:10000000:3.0:1788664450.851205:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 153: rc = 0 00100000:10000000:3.0:1788664450.851450:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 153: rc = 0 00100000:10000000:3.0:1788664450.851883:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 652: rc = 0 00100000:10000000:3.0:1788664450.852495:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788664450.852750:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 595: rc = 0 00100000:10000000:3.0:1788664450.852963:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788664450.853027:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 595: rc = 0 00100000:10000000:3.0:1788664450.853287:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788664450.853377:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 595: rc = 0 00100000:10000000:3.0:1788664450.853743:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788664450.853830:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00100000:10000000:3.0:1788664450.854020:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788664450.854086:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00100000:10000000:3.0:1788664450.854383:0:14363:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788664450.854455:0:14363:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00000020:00000080:3.0:1788664450.854771:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788664450.854780:0:14363:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788664450.854790:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be91164 00000020:01000004:3.0:1788664450.854812:0:14363:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788664450.854817:0:14363:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788664450.854822:0:14363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b68dff20800 from MGS 00000020:01000004:3.0:1788664450.854832:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788664450.854843:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b68f8fe8000) 00000020:00000080:3.0:1788664450.854853:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788664450.854913:0:14363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68dff20800 from MGS, refs=2 00080000:01000000:3.0:1788664450.854919:0:14363:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788664450.854924:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be91172 00000100:00100000:3.0:1788664450.855025:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788664450.855228:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788664450.855233:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788664450.855791:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788664450.855806:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788664450.856476:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664450.856621:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788664450.856625:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788664450.857065:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788664450.857071:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788664450.857546:0:14363:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788664450.857552:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788664450.858243:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664450.858246:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664450.858248:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664450.858666:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664450.858669:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664450.858671:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664450.859248:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788664450.860488:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788664450.870745:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788664450.870770:0:14363:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788664450.870773:0:14363:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788664450.872317:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788664450.872506:0:14363:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788664450.872595:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788664450.873194:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788664450.875197:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664450.875421:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788664450.875427:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788664450.876084:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788664450.876092:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788664450.876470:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788664450.876477:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788664450.877201:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788664450.877223:0:14363:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.114@tcp' 00000020:01000004:1.0:1788664450.877225:0:14363:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788664450.877256:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.114@tcp (typ=mgc) 00000020:00000080:1.0:1788664450.877270:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.114@tcp (ffff9b68f818b380) 00000020:00000080:1.0:1788664450.877286:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1788664450.877525:0:14376:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1788664450.877604:0:14363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b68f7d61800@MGC192.168.202.114@tcp: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788664450.877761:0:14363:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.114@tcp-0 is initialized 00000040:01000000:1.0:1788664450.877768:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788664450.878219:0:14377:0:(mgc_request.c:629:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788664450.878283:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.114@tcp (uuid 33c9a8d0-b33e-4394-b03e-6cd316e78cc0) 00000020:00000080:1.0:1788664450.878301:0:14363:0:(genops.c:1385:class_connect()) connect: client 33c9a8d0-b33e-4394-b03e-6cd316e78cc0, cookie 0x762f55027be91180 00000100:00080000:1.0:1788664450.878311:0:14363:0:(import.c:545:import_select_connection()) MGC192.168.202.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664450.878318:0:14363:0:(import.c:665:import_select_connection()) MGC192.168.202.114@tcp: import ffff9b68f7d61800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664450.878383:0:14363:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722ea00 x1875550222246784/t0(0) o250->MGC192.168.202.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664450.878455:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3306:1875550222246784:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788664450.878531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664450.878632:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222246784 00000100:00100000:3.0:1788664450.878640:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222246784 00000100:00100000:3.0:1788664450.878672:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664450.878679:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3306:x1875550222246784:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788664450.878714:0:14373:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 33c9a8d0-b33e-4394-b03e-6cd316e78cc0@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1788664450.878739:0:14373:0:(genops.c:1385:class_connect()) connect: client 33c9a8d0-b33e-4394-b03e-6cd316e78cc0, cookie 0x762f55027be91187 00000100:00080000:3.0:1788664450.878877:0:14373:0:(import.c:65:import_set_state_nolock()) ffff9b68c2d1a000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788664450.878941:0:14363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 33c9a8d0-b33e-4394-b03e-6cd316e78cc0->MGS 00000020:01000004:1.0:1788664450.878959:0:14363:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788664450.878964:0:14363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788664450.878975:0:14363:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b68f81899c0) 00000020:00000080:1.0:1788664450.878985:0:14363:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788664450.887570:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788664450.888914:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+5:3306:x1875550222246784:12345-0@lo:250:mount.lustre.0 Request processed in 10227us (10376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664450.888928:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664450.889181:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788664450.889190:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788664450.889812:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788664450.889818:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788664450.896105:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788664450.896122:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788664450.897950:0:3306:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788664450.897969:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.114@tcp: connect to target with instance 0 00000100:00080000:2.0:1788664450.897979:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788664450.897985:0:3306:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788664450.897990:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f7d61800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788664450.897993:0:3306:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788664450.898004:0:3306:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788664450.898012:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3306:1875550222246784:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788664450.898162:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664450.898366:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788664450.898373:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788664450.899739:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788664450.899748:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788664451.000502:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664451.000740:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788664451.000747:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788664451.002613:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788664451.002622:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788664451.003172:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664451.003421:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664451.003427:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788664451.003831:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664451.003837:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788664451.004589:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664451.004738:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664451.004743:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788664451.005155:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664451.005160:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788664451.005830:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664451.005974:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788664451.005978:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788664451.006413:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788664451.006419:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788664451.025383:0:14363:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664451.025564:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788664451.025572:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788664451.026894:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788664451.026901:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788664451.027635:0:14363:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788664451.027640:0:14363:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788664451.028232:0:14363:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788664451.028253:0:14363:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788664451.028258:0:14363:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788664451.028606:0:14363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788664451.028633:0:14363:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788664451.028636:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788664451.028637:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664451.028638:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664451.028639:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664451.028640:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664451.028641:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664451.028642:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664451.028643:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664451.028644:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664451.028644:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788664451.028646:0:14363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788664451.028648:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788664451.028648:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664451.028649:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664451.028649:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664451.028650:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664451.028651:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664451.028651:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664451.028652:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664451.028652:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664451.028653:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788664451.028674:0:14363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788664451.028687:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222246912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788664451.028748:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664451.028843:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222246912 00000100:00100000:0.0:1788664451.028846:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58e9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.028852:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222246912 00000100:00100000:3.0:1788664451.028907:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664451.028918:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+5:14363:x1875550222246912:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788664451.029067:0:14375:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788664451.029072:0:14375:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788664451.029075:0:14375:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788664451.029267:0:14396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788664451.029605:0:14375:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788664451.030248:0:14397:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788664451.030252:0:14397:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788664451.030253:0:14397:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788664451.030325:0:14397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788664451.030522:0:14375:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788664451.030528:0:14375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788664451.034437:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+5:14363:x1875550222246912:12345-0@lo:253:mount.lustre.0 Request processed in 5515us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.034448:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664451.034544:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222246912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788664451.034562:0:14363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788664451.034566:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788664451.034567:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664451.034568:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664451.034570:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664451.034571:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664451.034572:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664451.034573:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664451.034574:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664451.034576:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664451.034577:0:14363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788664451.034593:0:14363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b68dff20800 from lustre-MDT0000 10000000:01000000:0.0:1788664451.034614:0:14363:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788664451.034615:0:14363:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788664451.034619:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b68f818b380 10000000:01000000:0.0:1788664451.034622:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664451.034628:0:14363:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff9b68f818b380 from 1 10000000:01000000:0.0:1788664451.034630:0:14363:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788664451.034660:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.034667:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.034675:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.034688:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664451.034713:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.034738:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.034758:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222247040 00000100:00100000:3.0:1788664451.034765:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222247040 00000100:00100000:3.0:1788664451.034820:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664451.034830:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+5:14363:x1875550222247040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664451.034844:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664451.034858:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b2800/0x762f55027be9119c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be91195 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.034898:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b2800/0x762f55027be9119c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be91195 expref: 6 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.034908:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b2800/0x762f55027be9119c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be91195 expref: 6 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.034917:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2800, rc 0) 00000100:00100000:3.0:1788664451.034947:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+6:14363:x1875550222247040:12345-0@lo:101:mount.lustre.0 Request processed in 119us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.034954:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664451.034975:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664451.034995:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035004:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.035040:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664451.035056:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664451.035073:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222247168 00000100:00100000:0.0:1788664451.035076:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.035079:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222247168 00000100:00100000:3.0:1788664451.035112:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664451.035117:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+6:14363:x1875550222247168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664451.035290:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+6:14363:x1875550222247168:12345-0@lo:501:mount.lustre.0 Request processed in 172us (231us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664451.035296:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664451.035327:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247168:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788664451.035369:0:14363:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788664451.035380:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035388:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664451.035395:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b68dff20800 10000000:01000000:0.0:1788664451.035399:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788664451.035402:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b68dff20800 10000000:01000000:0.0:1788664451.035404:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788664451.035407:0:14363:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff9b68dff20800 from 1 10000000:01000000:0.0:1788664451.035409:0:14363:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788664451.035421:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66eee00/0x762f55027be911a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035428:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66eee00/0x762f55027be911a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035441:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66eee00/0x762f55027be911a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.035449:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664451.035478:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.035497:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.035508:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222247296 00000100:00100000:2.0:1788664451.035512:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222247296 00000100:00100000:2.0:1788664451.035550:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664451.035558:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+6:14363:x1875550222247296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664451.035574:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664451.035584:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c12eb800/0x762f55027be911aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be911a3 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.035598:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c12eb800/0x762f55027be911aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be911a3 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.035606:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c12eb800/0x762f55027be911aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be911a3 expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.035613:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12eb800, rc 0) 00000100:00100000:2.0:1788664451.035649:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+7:14363:x1875550222247296:12345-0@lo:101:mount.lustre.0 Request processed in 93us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.035656:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664451.035778:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664451.035786:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66eee00/0x762f55027be911a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be911aa expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035791:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66eee00/0x762f55027be911a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be911aa expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664451.035797:0:14363:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788664451.035806:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66eee00/0x762f55027be911a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be911aa expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035826:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66eee00/0x762f55027be911a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be911aa expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664451.035832:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788664451.035836:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664451.035840:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b68dff20800 10000000:01000000:0.0:1788664451.035842:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788664451.035845:0:14363:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788664451.035847:0:14363:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788664451.035858:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66eea00/0x762f55027be911b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035869:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66eea00/0x762f55027be911b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.035877:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66eea00/0x762f55027be911b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.035888:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664451.035910:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.035925:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.035950:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222247424 00000100:00100000:3.0:1788664451.035955:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222247424 00000100:00100000:3.0:1788664451.036040:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664451.036048:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+7:14363:x1875550222247424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664451.036055:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664451.036063:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3e00/0x762f55027be911b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be911b1 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.036075:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3e00/0x762f55027be911b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be911b1 expref: 8 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.036092:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b3e00/0x762f55027be911b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be911b1 expref: 8 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.036099:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b3e00, rc 0) 00000100:00100000:3.0:1788664451.036127:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+8:14363:x1875550222247424:12345-0@lo:101:mount.lustre.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.036133:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664451.036143:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664451.036153:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66eea00/0x762f55027be911b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be911b8 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.036158:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66eea00/0x762f55027be911b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be911b8 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.036185:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664451.036201:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.036215:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.036233:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222247552 00000100:00100000:2.0:1788664451.036237:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222247552 00000100:00100000:2.0:1788664451.036261:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788664451.036268:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+8:14363:x1875550222247552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664451.036620:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14363:x1875550222247552:12345-0@lo:501:mount.lustre.0 Request processed in 351us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.036627:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788664451.036647:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664451.036671:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664451.036703:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.036722:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.036746:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222247680 00000100:00100000:3.0:1788664451.036751:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222247680 00000100:00100000:3.0:1788664451.036791:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788664451.036800:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14363:x1875550222247680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664451.037180:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14363:x1875550222247680:12345-0@lo:503:mount.lustre.0 Request processed in 380us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.037186:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788664451.037224:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222247680:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664451.037563:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14398:1875550222247808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664451.037599:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664451.037625:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3fef240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.037635:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222247808 00000100:00100000:2.0:1788664451.037640:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222247808 00000100:00100000:2.0:1788664451.037665:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788664451.037670:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14398:x1875550222247808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664451.037842:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14398:x1875550222247808:12345-0@lo:502:llog_process_th.0 Request processed in 171us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.037853:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664451.037941:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14398:1875550222247808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788664451.037958:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664451.037977:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.037979:0:14398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788664451.037984:0:14398:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788664451.037987:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664451.038000:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b68f8fecd40) 00000020:00000080:3.0:1788664451.038016:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788664451.038020:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788664451.038068:0:14398:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788664451.038073:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be911c6 00000020:00000080:3.0:1788664451.038228:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788664451.038232:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664451.038234:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.038235:0:14398:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788664451.038236:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664451.038239:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.038240:0:14398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788664451.038242:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664451.038247:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b68f8fe99c0) 00000020:00000080:3.0:1788664451.038252:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788664451.038254:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788664451.038256:0:14398:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788664451.038258:0:14398:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788664451.038261:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788664451.038307:0:14398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68dff20800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788664451.038321:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b68f82e8000) 00000020:00000080:3.0:1788664451.038326:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788664451.038386:0:14398:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788664451.038394:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be911db 00000020:00000080:3.0:1788664451.038457:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788664451.038461:0:14398:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788664451.038464:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x762f55027be911e2 00080000:01000000:3.0:1788664451.038467:0:14398:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788664451.038469:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be911e9 00010000:00010000:3.0:1788664451.078481:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788664451.079360:0:14398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788664451.079526:0:14398:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788664451.081148:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b68f82eb380) 00000020:00000080:3.0:1788664451.081168:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788664451.081249:0:14398:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788664451.081257:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be911f7 00000020:00000080:1.0:1788664451.082727:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788664451.089804:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x762f55027be911fe 00000020:00000080:1.0:1788664451.090174:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788664451.090187:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664451.090192:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664451.090194:0:14398:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788664451.090198:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664451.090203:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664451.090204:0:14398:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788664451.090208:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788664451.090236:0:14398:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788664451.090246:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664451.090249:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664451.090250:0:14398:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788664451.090252:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788664451.090254:0:14398:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1788664451.090256:0:14398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664451.090257:0:14398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788664451.090258:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788664451.090260:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664451.090261:0:14398:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788664451.090263:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788664451.090276:0:14398:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788664451.090280:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664451.090281:0:14398:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788664451.090284:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788664451.090288:0:14398:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:1.0:1788664451.090312:0:14398:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788664451.090314:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664451.090328:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b68f818cd40) 00000020:00000080:1.0:1788664451.090435:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788664451.090449:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788664451.090506:0:14398:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788664451.090511:0:14398:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788664451.090516:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be9120c 00010000:00080000:1.0:1788664451.090557:0:14398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b68e6673800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788664451.090755:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788664451.091119:0:14398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788664451.091162:0:14398:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788664451.091993:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664451.092062:0:14398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788664451.092130:0:14398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788664451.092659:0:14402:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788664451.092663:0:14402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788664451.093192:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788664451.093200:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788664451.093224:0:14398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788664451.093236:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be91213 00000100:00080000:3.0:1788664451.093244:0:14398:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664451.093249:0:14398:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b68e6673800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664451.093281:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68e7edd500 x1875550222247936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664451.093308:0:14398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788664451.093377:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222247936:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788664451.093431:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550222247936 offset 0 length 520: 4 00000020:01000000:3.0:1788664451.093443:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664451.093447:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.093448:0:14398:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788664451.093451:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788664451.093453:0:14398:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788664451.093455:0:14398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788664451.093457:0:14398:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788664451.093458:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788664451.093460:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.093461:0:14398:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788664451.093464:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788664451.093468:0:14398:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788664451.093471:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.093472:0:14398:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788664451.093475:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788664451.093479:0:14398:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.114@tcp to nid 0x20000c0a8ca72 (192.168.202.114@tcp) 00000020:01000000:3.0:1788664451.093498:0:14398:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788664451.093501:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788664451.093511:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b68f82e99c0) 00000020:00000080:3.0:1788664451.093521:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788664451.093525:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788664451.093590:0:14398:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788664451.093601:0:14398:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788664451.093606:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x762f55027be91221 00010000:00080000:3.0:1788664451.093634:0:14398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b68f8d65000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:3.0:1788664451.093825:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788664451.093952:0:14398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788664451.093972:0:14398:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788664451.094435:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788664451.094480:0:14398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788664451.094532:0:14398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788664451.094840:0:14404:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788664451.094844:0:14404:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788664451.095461:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788664451.095469:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788664451.095490:0:14398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788664451.095501:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be91228 00000100:00080000:3.0:1788664451.095507:0:14398:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664451.095511:0:14398:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b68f8d65000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664451.095535:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68e7edc000 x1875550222248064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788664451.095559:0:14398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788664451.095600:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222248064:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788664451.095601:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664451.095605:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.095606:0:14398:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788664451.095609:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664451.095612:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.095614:0:14398:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788664451.095616:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664451.095618:0:14398:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788664451.095620:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664451.095622:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.095623:0:14398:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788664451.095625:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664451.095627:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664451.095635:0:14398:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788664451.095639:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:2.0:1788664451.095660:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550222248064 offset 0 length 520: 4 00000100:00100000:3.0:1788664451.095664:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14398:1875550222248192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664451.095707:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664451.095731:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c3fef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.095868:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222248192 00000100:00100000:2.0:1788664451.095874:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222248192 00000100:00100000:2.0:1788664451.095915:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664451.095924:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14398:x1875550222248192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664451.096130:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14398:x1875550222248192:12345-0@lo:502:llog_process_th.0 Request processed in 206us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.096138:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788664451.096156:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14398:1875550222248192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788664451.096179:0:14398:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664451.096184:0:14398:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664451.096186:0:14398:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788664451.096191:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788664451.096332:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788664451.096385:0:14363:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788664451.096397:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66eea00/0x762f55027be911b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be911b8 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.096409:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66eea00/0x762f55027be911b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be911b8 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664451.096417:0:14363:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68dff20800 from 1 10000000:01000000:0.0:1788664451.096420:0:14363:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788664451.096443:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.096451:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.096461:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.096473:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664451.096500:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.096515:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664451.096570:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222248320 00000100:00100000:1.0:1788664451.096573:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222248320 00000100:00100000:1.0:1788664451.096595:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664451.096603:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+9:14363:x1875550222248320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664451.096612:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664451.096626:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9122f expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664451.096646:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9122f expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664451.096665:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9122f expref: 10 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664451.096674:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3000, rc 0) 00000100:00100000:1.0:1788664451.096706:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+10:14363:x1875550222248320:12345-0@lo:101:mount.lustre.0 Request processed in 104us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664451.096710:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788664451.096919:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664451.096937:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.096943:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.097710:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248448:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788664451.097745:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.097773:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.097792:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222248448 00000100:00100000:3.0:1788664451.097797:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222248448 00000100:00100000:3.0:1788664451.097844:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788664451.097852:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+10:14363:x1875550222248448:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788664451.097867:0:14375:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788664451.097873:0:14375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788664451.097943:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+10:14363:x1875550222248448:12345-0@lo:256:mount.lustre.0 Request processed in 91us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.097949:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788664451.098099:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248448:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788664451.098703:0:14363:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788664451.098798:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.098806:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664451.098810:0:14363:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68dff20800 from 1 10000000:01000000:0.0:1788664451.098822:0:14363:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664451.098849:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.098856:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.098866:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.098880:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664451.098904:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.098953:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664451.099081:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222248576 00000100:00100000:1.0:1788664451.099086:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222248576 00000100:00100000:1.0:1788664451.099114:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664451.099122:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+10:14363:x1875550222248576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664451.099132:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664451.099146:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9123d expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664451.099163:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9123d expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664451.099170:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9123d expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664451.099175:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2e00, rc 0) 00000100:00100000:1.0:1788664451.099228:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14363:x1875550222248576:12345-0@lo:101:mount.lustre.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664451.099232:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664451.099315:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664451.099325:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.099409:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.099457:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664451.099480:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.099501:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.099515:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222248704 00000100:00100000:3.0:1788664451.099519:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222248704 00000100:00100000:3.0:1788664451.099544:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788664451.099550:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14363:x1875550222248704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664451.099850:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14363:x1875550222248704:12345-0@lo:501:mount.lustre.0 Request processed in 299us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.099857:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788664451.099871:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664451.099896:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664451.100060:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.100095:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664451.100116:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222248832 00000100:00100000:1.0:1788664451.100119:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222248832 00000100:00100000:1.0:1788664451.100144:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664451.100154:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14363:x1875550222248832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664451.100300:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14363:x1875550222248832:12345-0@lo:503:mount.lustre.0 Request processed in 146us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664451.100304:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664451.100489:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222248832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664451.100798:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14406:1875550222248960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664451.100834:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.100857:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1788664451.100873:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222248960 00000100:00100000:3.0:1788664451.100877:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222248960 00000100:00100000:3.0:1788664451.100904:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788664451.100909:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14406:x1875550222248960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664451.101077:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14406:x1875550222248960:12345-0@lo:502:llog_process_th.0 Request processed in 167us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664451.101093:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788664451.101094:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14406:1875550222248960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788664451.101112:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664451.101121:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664451.101124:0:14406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788664451.101131:0:14406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68dff20800 00000020:00000080:0.0:1788664451.101133:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788664451.101141:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664451.101144:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664451.101146:0:14406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788664451.101148:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664451.101150:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664451.101156:0:14406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788664451.101161:0:14406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68dff20800 00000020:00000080:0.0:1788664451.101163:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788664451.101219:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664451.101223:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664451.101224:0:14406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788664451.101227:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664451.101229:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664451.101231:0:14406:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788664451.101234:0:14406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b68dff20800 00000020:00000080:0.0:1788664451.101236:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788664451.101283:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14406:1875550222249088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788664451.101312:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.101403:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1788664451.101508:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249088 00000100:00100000:1.0:1788664451.101512:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249088 00000100:00100000:1.0:1788664451.101588:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664451.101595:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14406:x1875550222249088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664451.101723:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14406:x1875550222249088:12345-0@lo:502:llog_process_th.0 Request processed in 128us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664451.101730:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788664451.101786:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14406:1875550222249088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788664451.101804:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664451.101808:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664451.101810:0:14406:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788664451.101825:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788664451.102255:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788664451.102484:0:14363:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788664451.102548:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.102559:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664451.102608:0:14363:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788664451.102611:0:14363:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff9b68dff20800 10000000:01000000:2.0:1788664451.102615:0:14363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b68dff20800 10000000:01000000:2.0:1788664451.102619:0:14363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788664451.102625:0:14363:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68dff20800 from 1 10000000:01000000:2.0:1788664451.102628:0:14363:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788664451.102661:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea800/0x762f55027be9124b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.102670:0:14363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea800/0x762f55027be9124b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.102680:0:14363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea800/0x762f55027be9124b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664451.102698:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788664451.102737:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.102768:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249216 00000100:00100000:2.0:1788664451.102772:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249216 00000100:00100000:2.0:1788664451.102799:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788664451.102807:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14363:x1875550222249216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664451.102828:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664451.102841:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c12ea400/0x762f55027be91252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9124b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.102866:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c12ea400/0x762f55027be91252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9124b expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.102878:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c12ea400/0x762f55027be91252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9124b expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.102887:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea400, rc 0) 00000100:00100000:2.0:1788664451.102914:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14363:x1875550222249216:12345-0@lo:101:mount.lustre.0 Request processed in 108us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.102920:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788664451.103153:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.103170:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664451.103184:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea800/0x762f55027be9124b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91252 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.103192:0:14363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea800/0x762f55027be9124b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91252 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664451.103238:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664451.103262:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.103381:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249344 00000100:00100000:2.0:1788664451.103385:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249344 00000100:00100000:2.0:1788664451.103405:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664451.103411:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14363:x1875550222249344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664451.103775:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14363:x1875550222249344:12345-0@lo:501:mount.lustre.0 Request processed in 362us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.103781:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788664451.105227:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.105256:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664451.106241:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664451.107198:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.107261:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664451.107393:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249472 00000100:00100000:1.0:1788664451.107401:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249472 00000100:00100000:1.0:1788664451.107450:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788664451.107459:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14363:x1875550222249472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664451.107877:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14363:x1875550222249472:12345-0@lo:503:mount.lustre.0 Request processed in 418us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664451.107887:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788664451.108384:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f06300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664451.108662:0:14410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14410:1875550222249600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788664451.108706:0:14410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664451.108738:0:14410:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c617e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.109202:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249600 00000100:00100000:2.0:1788664451.109207:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249600 00000100:00100000:2.0:1788664451.109242:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788664451.109256:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14410:x1875550222249600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788664451.111186:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14410:x1875550222249600:12345-0@lo:502:llog_process_th.0 Request processed in 1921us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.111200:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788664451.111314:0:14410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14410:1875550222249600:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788664451.111428:0:14410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788664451.111443:0:14410:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b68f82ecd40) 00000020:00000080:3.0:1788664451.111460:0:14410:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788664451.112676:0:14410:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68dff20800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788664451.112684:0:14410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68dff20800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788664451.112687:0:14410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68dff20800 4 00010000:00080000:3.0:1788664451.112725:0:14410:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b68f8195800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.114@tcp at head 00010000:00010000:3.0:1788664451.116679:0:14410:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788664451.119566:0:14410:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788664451.119605:0:14410:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788664451.119618:0:14410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x762f55027be91260 00000100:00080000:1.0:1788664451.119628:0:14410:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664451.119634:0:14410:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b68f8195800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664451.119666:0:14410:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722e680 x1875550222249728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664451.119701:0:14410:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788664451.119837:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222249728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788664451.119904:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664451.127020:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249728 00000100:00100000:1.0:1788664451.127036:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249728 00000100:00100000:1.0:1788664451.127094:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664451.127103:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875550222249728:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664451.127224:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3306:x1875550222249728:12345-0@lo:38:llog_process_th.0 Request processed in 119us (7318us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788664451.127231:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664451.128478:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664451.128490:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8195800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664451.128496:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788664451.128500:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222249728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664451.128713:0:14410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14410:1875550222249856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664451.128786:0:14410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664451.128846:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249856 00000100:00100000:1.0:1788664451.128852:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249856 00000100:00100000:1.0:1788664451.128889:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664451.128897:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14410:x1875550222249856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788664451.129132:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14410:x1875550222249856:12345-0@lo:502:llog_process_th.0 Request processed in 235us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664451.129140:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788664451.129182:0:14410:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664451.129193:0:14410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14410:1875550222249856:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788664451.129212:0:14410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788664451.131292:0:14363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788664451.131323:0:14363:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788664451.131471:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea800/0x762f55027be9124b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91252 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664451.131484:0:14363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c12ea800/0x762f55027be9124b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91252 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788664451.131878:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788664451.131881:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788664451.131882:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664451.131883:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664451.131884:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664451.131886:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664451.131887:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664451.131889:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788664451.131890:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664451.131892:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664451.131895:0:14363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788664451.131898:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788664451.131899:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788664451.131900:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664451.131902:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664451.131903:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664451.131904:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664451.131905:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788664451.131906:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788664451.131912:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664451.131913:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788664451.131951:0:14363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788664451.131969:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249984:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788664451.132029:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664451.132061:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7ebde40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664451.132154:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222249984 00000100:00100000:2.0:1788664451.132160:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222249984 00000100:00100000:2.0:1788664451.132239:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664451.132248:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14363:x1875550222249984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664451.132288:0:14375:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788664451.132302:0:14375:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788664451.238522:0:14375:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788664451.238563:0:14375:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788664451.238643:0:14396:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788664451.238650:0:14396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788664451.238677:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.238697:0:14396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9122f expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.238707:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.238748:0:14396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9122f expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.238762:0:14396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9122f expref: 12 pid: 14373 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664451.238792:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14396:1875550222250112:0@lo:104: 00000100:00100000:3.0:1788664451.238878:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664451.238941:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c581b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664451.239026:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222250112 00000100:00100000:1.0:1788664451.239035:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222250112 00000100:00100000:1.0:1788664451.239087:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664451.239096:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14396:x1875550222250112:12345-0@lo:104: 00010000:00010000:1.0:1788664451.239112:0:14364:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664451.239177:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664451.239184:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14396:x1875550222250112:12345-0@lo:104: Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664451.239191:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664451.239429:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14396:1875550222250112:0@lo:104: 00010000:00010000:3.0:1788664451.239449:0:14396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.239609:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664451.239618:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.239627:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664451.239631:0:14370:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.239639:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664451.239647:0:14370:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664451.239661:0:14370:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664451.239733:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.239739:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664451.239770:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.239777:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be9122f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91236 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.239793:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664451.239795:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664451.239797:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664451.239873:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222250240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664451.239905:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664451.240116:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222250240 00000100:00100000:0.0:1788664451.240122:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222250240 00010000:00010000:0.0:1788664451.240144:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9122f expref: 13 pid: 14373 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664451.240179:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664451.240186:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+13:3308:x1875550222250240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664451.240199:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664451.240204:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9122f expref: 13 pid: 14373 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240214:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9122f expref: 13 pid: 14373 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240227:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68d15f3000/0x762f55027be91236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9122f expref: 13 pid: 14373 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240248:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240256:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788664451.240269:0:14366:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001621168s 00010000:00010000:0.0:1788664451.240274:0:14366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240418:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240425:0:14366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240430:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240435:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b3c00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664451.240439:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.240446:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.245029:0:14396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664451.245046:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.245085:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.245096:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68f88b3c00/0x762f55027be91267 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664451.245136:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664451.245232:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:3308:x1875550222250240:12345-0@lo:103:ldlm_bl.0 Request processed in 5043us (5322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664451.245242:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788664451.245632:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222250240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664451.252717:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14363:x1875550222249984:12345-0@lo:253:mount.lustre.0 Request processed in 120454us (120671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664451.252735:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788664451.252758:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14363:1875550222249984:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788664451.252774:0:14363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788664451.252778:0:14363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788664451.252779:0:14363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788664451.252781:0:14363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664451.252782:0:14363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664451.252784:0:14363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664451.252785:0:14363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664451.252786:0:14363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788664451.252788:0:14363:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788664451.252790:0:14363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664451.252792:0:14363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788664451.252810:0:14363:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788664451.260524:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664451.260692:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788664451.261066:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664451.261223:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788664451.261570:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788664451.261718:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788664451.262811:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664451.263637:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788664451.263932:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664451.264259:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788664451.264648:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664451.264780:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788664451.312815:0:14363:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788664451.314155:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788664451.314564:0:14420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000020:00080000:0.0:1788664451.314572:0:14419:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788664451.314576:0:14419:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788664451.314661:0:14420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664451.317153:0:14420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788664451.317228:0:14420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788664451.317233:0:14420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788664451.318248:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788664451.318406:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788664451.319037:0:14363:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788664451.319052:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788664451.319184:0:14363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664451.320317:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788664451.321014:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788664451.321050:0:14363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788664451.328616:0:14363:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788664451.333275:0:14363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788664451.371895:0:14363:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788664451.371949:0:14363:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac80419cf988 00100000:10000000:0.0:1788664451.372180:0:14363:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788664451.373644:0:14363:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788664451.373665:0:14363:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788664451.373686:0:14363:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788664451.373704:0:14363:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788664451.871838:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788664452.131221:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788664452.704441:0:14377:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788664452.704449:0:14377:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68dff20800 from 6 10000000:01000000:2.0:1788664452.704454:0:14377:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788664452.704502:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664452.704515:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664452.704526:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664452.704553:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222250368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788664452.704626:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664452.704674:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c617e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664452.704817:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222250368 00000100:00100000:1.0:1788664452.704825:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222250368 00000100:00100000:1.0:1788664452.704886:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788664452.704895:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14377:x1875550222250368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664452.704917:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664452.704932:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9126e expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664452.704955:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9126e expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664452.704965:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9126e expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664452.704975:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2c00, rc 0) 00000100:00100000:1.0:1788664452.705028:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222250368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664452.705035:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788664452.705094:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222250368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664452.705109:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664452.705118:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664452.705166:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222250496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788664452.705198:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664452.705216:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf000 going to sleep for 11 seconds 00000100:00100000:2.0:1788664452.705392:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222250496 00000100:00100000:2.0:1788664452.705396:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222250496 00000100:00100000:2.0:1788664452.705425:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664452.705433:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222250496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788664452.705446:0:14374:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788664452.705461:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788664452.705464:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788664452.705534:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222250496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664452.705541:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788664452.705682:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222250496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788664452.705731:0:14377:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788664452.705738:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664452.705746:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664452.899888:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788664453.154641:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788664453.919835:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664454.944966:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664455.968473:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788664456.161199:0:14663:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788664456.486423:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664456.486431:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664456.486433:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664456.486436:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664456.486446:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788664456.486450:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788664456.486455:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b68f8195800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664456.486467:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b68f8195800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664456.486492:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722d500 x1875550222250752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664456.486639:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788664456.486653:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3310:1875550222250624:0@lo:400:kworker.0 00000100:00100000:1.0:1788664456.486719:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664456.486776:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222250624 00000100:00100000:1.0:1788664456.486783:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222250624 00000100:00100000:1.0:1788664456.486825:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664456.486836:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:3310:x1875550222250624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664456.486884:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:3310:x1875550222250624:12345-0@lo:400:kworker.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664456.486892:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788664456.486935:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3310:1875550222250624:0@lo:400:kworker.0 00000100:00100000:1.0:1788664456.486956:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222250752:0@lo:38:kworker.0 00000100:00100000:1.0:1788664456.486981:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664456.487014:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222250752 00000100:00100000:1.0:1788664456.487018:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222250752 00000100:00100000:1.0:1788664456.487124:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664456.487130:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875550222250752:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788664456.487153:0:14382:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:1.0:1788664456.487188:0:14382:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x762f55027be9127c 00000004:00100000:1.0:1788664456.487211:0:14382:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788664456.487336:0:14382:0:(import.c:65:import_set_state_nolock()) ffff9b68c7f8c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664456.487414:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875550222250752:12345-0@lo:38:kworker.0 Request processed in 281us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664456.487421:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788664456.487452:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b67c722d500 x1875550222250752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788664456.487466:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788664456.487473:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788664456.487477:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664456.487480:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8195800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664456.487485:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875550222250752:0@lo:38:kworker.0 00010000:00010000:1.0:1788664456.991630:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664458.016243:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664459.039678:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664460.063865:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788664460.320620:0:14813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb2930ba0 20000000:00000080:1.0:1788664460.320641:0:14813:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b68d8969400 uarg=0000000000000000 20000000:01000000:1.0:1788664460.320678:0:14813:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788664460.320686:0:14813:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788664460.320691:0:14813:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788664460.322676:0:14814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788664460.323020:0:14813:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788664460.333149:0:14813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788664460.338292:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664460.338321:0:14813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9123d expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664460.338330:0:14813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664460.338404:0:14813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9123d expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664460.338450:0:14813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9123d expref: 11 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664460.338465:0:14813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14813:1875550222250880:0@lo:104: 00000100:00100000:3.0:1788664460.338539:0:14813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664460.338616:0:14813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664460.339078:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222250880 00000100:00100000:2.0:1788664460.339088:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222250880 00000100:00100000:2.0:1788664460.339194:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664460.339205:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14813:x1875550222250880:12345-0@lo:104: 00010000:00010000:2.0:1788664460.339220:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664460.339290:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664460.339297:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14813:x1875550222250880:12345-0@lo:104: Request processed in 95us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664460.339305:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664460.339397:0:14813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14813:1875550222250880:0@lo:104: 00010000:00010000:3.0:1788664460.339418:0:14813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.339588:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664460.339605:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.339613:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ef800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664460.339617:0:14370:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.339626:0:14370:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664460.339634:0:14370:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664460.339640:0:14370:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788664460.339678:0:14370:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.339685:0:14370:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664460.339738:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.339746:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be9123d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91244 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.339762:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664460.339764:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664460.339766:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664460.339863:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664460.339876:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222251008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664460.339909:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664460.340069:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222251008 00000100:00100000:0.0:1788664460.340074:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222251008 00010000:00010000:0.0:1788664460.340093:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9123d expref: 12 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664460.340123:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664460.340131:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:3309:x1875550222251008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788664460.340143:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664460.340148:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9123d expref: 12 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340159:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9123d expref: 12 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340171:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68d15f2e00/0x762f55027be91244 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9123d expref: 12 pid: 14373 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340187:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340196:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340218:0:14367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340225:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340231:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340237:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340242:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b3600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664460.340246:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340252:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340271:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664460.340280:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664460.340323:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:3309:x1875550222251008:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664460.340331:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788664460.340518:0:14813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664460.340526:0:14813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664460.340532:0:14813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68f88b3600/0x762f55027be91283 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664460.341481:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222251008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664461.088959:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788664461.599783:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664461.599789:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664461.599792:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664461.599796:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788664461.599910:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3307:1875550222251136:0@lo:400:kworker.0 00000100:00100000:2.0:1788664461.599986:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664461.600044:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788664461.600051:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222251264:0@lo:400:kworker.0 00000100:00100000:2.0:1788664461.600079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664461.600113:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222251136 00000100:00100000:2.0:1788664461.600120:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222251136 00000100:00100000:2.0:1788664461.600175:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664461.600185:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:3307:x1875550222251136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664461.600235:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:3307:x1875550222251136:12345-0@lo:400:kworker.0 Request processed in 51us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664461.600242:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788664461.600288:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222251264 00000100:00100000:2.0:1788664461.600305:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222251264 00000100:00100000:2.0:1788664461.600335:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788664461.600361:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222251264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664461.600397:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222251264:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664461.600404:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788664461.600443:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b67c722c000 x1875550222251264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664461.600457:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222251264:0@lo:400:kworker.0 00000100:00100000:2.0:1788664461.600467:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3307:1875550222251136:0@lo:400:kworker.0 00000100:00100000:0.0:1788664461.600642:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664451/real 1788664451] req@ffff9b68e7edc000 x1875550222248064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664461.600661:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b68e7edc000 x1875550222248064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664461.600679:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664451/real 1788664451] req@ffff9b68e7edd500 x1875550222247936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664461.600692:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b68e7edd500 x1875550222247936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788664461.600705:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664461.600723:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664461.600726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222248064:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788664461.600731:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68e6673800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788664461.600736:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788664461.600738:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222247936:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788664461.600837:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664461.600848:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788664461.600851:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b68e6673800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664461.600856:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788664461.600860:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788664461.600866:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b68e6673800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664461.600890:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722c700 x1875550222251392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664461.600906:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664461.600910:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788664461.600912:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664461.600914:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788664461.600917:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788664461.600921:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b68f8d65000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664461.600929:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222251392:0@lo:8:kworker.0 00000400:00000100:1.0:1788664461.600958:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550222251392 offset 0 length 520: 4 00000100:00100000:1.0:1788664461.600999:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722dc00 x1875550222251520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664461.601018:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222251520:0@lo:8:kworker.0 00000400:00000100:1.0:1788664461.601040:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875550222251520 offset 0 length 520: 4 10000000:01000000:3.0:1788664461.994474:0:14377:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788664461.994482:0:14377:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68dff20800 from 10 10000000:01000000:3.0:1788664461.994487:0:14377:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788664461.994542:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664461.994565:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664461.994577:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664461.994600:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222251648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664461.994801:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664461.994853:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664461.998792:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222251648 00000100:00100000:2.0:1788664461.998809:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222251648 00000100:00100000:2.0:1788664461.998879:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788664461.998889:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+11:14377:x1875550222251648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664461.998907:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664461.998926:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9128a expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664461.998951:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9128a expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664461.998963:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9128a expref: 12 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664461.998972:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c12ea600, rc 0) 00000100:00100000:2.0:1788664461.999062:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222251648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664461.999086:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788664462.001819:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222251648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664462.001855:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664462.001869:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664462.001954:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222251776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664462.002023:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664462.002060:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664462.002782:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222251776 00000100:00100000:2.0:1788664462.002791:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222251776 00000100:00100000:2.0:1788664462.002835:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664462.002846:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222251776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664462.003136:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222251776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664462.003144:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788664462.003194:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222251776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664462.003251:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222251904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664462.003292:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664462.003316:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68dcb46c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788664462.003678:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222251904 00000100:00100000:1.0:1788664462.003685:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222251904 00000100:00100000:1.0:1788664462.003721:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664462.003730:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222251904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664462.003884:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:14377:x1875550222251904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664462.003897:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788664462.004499:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222251904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788664462.005478:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788664462.005847:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788664462.005871:0:14377:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788664462.005882:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664462.005895:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664462.115610:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664463.135706:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788664463.395035:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788664464.159536:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664465.183802:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664466.219494:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788664466.725408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664466.725416:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788664466.725419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788664466.725422:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788664466.725455:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222252032:0@lo:400:kworker.0 00000100:00100000:2.0:1788664466.725526:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664466.725577:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664466.725583:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222252160:0@lo:400:kworker.0 00000100:00100000:2.0:1788664466.725666:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664466.725700:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252032 00000100:00100000:2.0:1788664466.725706:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252032 00000100:00100000:2.0:1788664466.725745:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664466.725753:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:3309:x1875550222252032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664466.725799:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:3309:x1875550222252032:12345-0@lo:400:kworker.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664466.725806:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788664466.725836:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252160 00000100:00100000:2.0:1788664466.725839:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252160 00000100:00100000:2.0:1788664466.726211:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664466.726220:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222252160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664466.726255:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222252160:12345-0@lo:400:kworker.0 Request processed in 37us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664466.726261:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788664466.726424:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b68e7f05f80 x1875550222252160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664466.726439:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222252160:0@lo:400:kworker.0 00000100:00100000:2.0:1788664466.726449:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222252032:0@lo:400:kworker.0 00000020:01000004:3.0:1788664466.813615:0:15063:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:3.0:1788664466.813619:0:15063:0:(obd_mount.c:924:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788664466.813754:0:15063:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b68f85c2800 00000020:01000004:3.0:1788664466.813769:0:15063:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788664466.813781:0:15063:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788664466.813804:0:15063:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b68f9fc4d40) 00000020:00000080:3.0:1788664466.813821:0:15063:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788664466.848986:0:15063:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788664466.849273:0:15063:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788664466.851920:0:15063:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788664466.852256:0:15063:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788664466.852699:0:15063:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788664466.853045:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 227: rc = 0 00100000:10000000:0.0:1788664466.853404:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 227: rc = 0 00100000:10000000:0.0:1788664466.853798:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 227: rc = 0 00100000:10000000:0.0:1788664466.854500:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 437: rc = 0 00100000:10000000:0.0:1788664466.854998:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 437: rc = 0 00100000:10000000:0.0:1788664466.856853:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 437: rc = 0 00100000:10000000:0.0:1788664466.857162:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 437: rc = 0 00100000:10000000:0.0:1788664466.857458:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 437: rc = 0 00100000:10000000:0.0:1788664466.857697:0:15063:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 437: rc = 0 00000020:00000080:0.0:1788664466.858251:0:15063:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788664466.858262:0:15063:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788664466.858272:0:15063:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x762f55027be9129f 00000020:01000004:0.0:1788664466.858281:0:15063:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788664466.858301:0:15063:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788664466.858304:0:15063:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788664466.858310:0:15063:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788664466.858314:0:15063:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788664466.858326:0:15063:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b68c3f919c0) 00000020:00000080:0.0:1788664466.858337:0:15063:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788664466.859382:0:15063:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664466.859526:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788664466.859531:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788664466.866816:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788664466.866828:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788664466.867212:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788664466.867220:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788664466.869860:0:15063:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664466.870065:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788664466.870073:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788664466.871098:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788664466.871107:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788664466.897203:0:15063:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788664466.897909:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788664466.897916:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788664466.900078:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788664466.900093:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788664466.902189:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788664466.902202:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788664466.905073:0:15063:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788664466.905332:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788664466.905338:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788664466.906788:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788664466.906798:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788664466.950646:0:15063:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788664466.950970:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788664466.950977:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788664466.952307:0:15063:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788664466.952318:0:15063:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788664466.956043:0:15063:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788664466.956070:0:15063:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788664466.956077:0:15063:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788664466.971940:0:15063:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788664466.971984:0:15063:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.114@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788664466.971989:0:15063:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788664466.971990:0:15063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664466.971992:0:15063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664466.971993:0:15063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664466.971994:0:15063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664466.971995:0:15063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664466.971997:0:15063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664466.971999:0:15063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664466.972000:0:15063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664466.972004:0:15063:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788664466.972006:0:15063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788664466.972007:0:15063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664466.972008:0:15063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664466.972009:0:15063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664466.972010:0:15063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664466.972011:0:15063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664466.972012:0:15063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664466.972013:0:15063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664466.972014:0:15063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788664466.972040:0:15063:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788664466.972059:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252288:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788664466.972126:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664466.972298:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e65f8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664466.972816:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252288 00000100:00100000:2.0:1788664466.972824:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252288 00000100:00100000:2.0:1788664466.972917:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788664466.972927:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:15063:x1875550222252288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664466.972969:0:14374:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788664466.972972:0:14374:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788664466.972976:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788664466.988307:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:15063:x1875550222252288:12345-0@lo:253:mount.lustre.0 Request processed in 15372us (16171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664466.988323:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788664466.988491:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252288:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788664466.988525:0:15063:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788664466.988529:0:15063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664466.988533:0:15063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664466.988534:0:15063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664466.988536:0:15063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664466.988537:0:15063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664466.988538:0:15063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664466.988540:0:15063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664466.988542:0:15063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664466.988543:0:15063:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788664466.988627:0:15063:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b68f85c2800 from lustre-OST0000 10000000:01000000:2.0:1788664466.988648:0:15063:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788664466.988650:0:15063:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788664466.988656:0:15063:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b68f818b380 local copy 00010000:00010000:2.0:1788664466.988666:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664466.988890:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664466.988924:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664466.988961:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788664466.989162:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252416 00000100:00100000:3.0:1788664466.989170:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252416 00000100:00100000:3.0:1788664466.989215:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788664466.989224:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:15063:x1875550222252416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788664466.989392:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:15063:x1875550222252416:12345-0@lo:501:mount.lustre.0 Request processed in 169us (467us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788664466.989400:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788664466.989582:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252416:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788664466.989596:0:15063:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788664466.989747:0:15063:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788664466.989754:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.989765:0:15063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664466.989797:0:15063:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b68f85c2800 10000000:01000000:2.0:1788664466.989802:0:15063:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788664466.989806:0:15063:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b68f818b380 10000000:01000000:2.0:1788664466.989808:0:15063:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788664466.989812:0:15063:0:(mgc_request.c:1800:mgc_process_log()) Process log nodemap-ffff9b68f818b380 from 1 10000000:01000000:2.0:1788664466.989815:0:15063:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788664466.989841:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eaa00/0x762f55027be912ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.989860:0:15063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c12eaa00/0x762f55027be912ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.989869:0:15063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c12eaa00/0x762f55027be912ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664466.989883:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788664466.989921:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664466.989954:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aa900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.990295:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252544 00000100:00100000:0.0:1788664466.990300:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252544 00000100:00100000:0.0:1788664466.990328:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788664466.990333:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+12:15063:x1875550222252544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664466.990381:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664466.990608:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66eec00/0x762f55027be912b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be912ad expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.990630:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66eec00/0x762f55027be912b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be912ad expref: 13 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.990638:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66eec00/0x762f55027be912b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be912ad expref: 13 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.990645:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66eec00, rc 0) 00000100:00100000:0.0:1788664466.990684:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+13:15063:x1875550222252544:12345-0@lo:101:mount.lustre.0 Request processed in 350us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.990699:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788664466.990777:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252544:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664466.990792:0:15063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c12eaa00/0x762f55027be912ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912b4 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.990801:0:15063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c12eaa00/0x762f55027be912ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be912b4 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664466.990817:0:15063:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788664466.990884:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12eaa00/0x762f55027be912ad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912b4 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.990903:0:15063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c12eaa00/0x762f55027be912ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912b4 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664466.990909:0:15063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788664466.990913:0:15063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788664466.990917:0:15063:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788664466.990920:0:15063:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788664466.990938:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ebc00/0x762f55027be912bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.990945:0:15063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c12ebc00/0x762f55027be912bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.990951:0:15063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c12ebc00/0x762f55027be912bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664466.990964:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788664466.990989:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664466.991022:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aa900 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.991078:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252672 00000100:00100000:0.0:1788664466.991083:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252672 00000100:00100000:0.0:1788664466.991113:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788664466.991120:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+13:15063:x1875550222252672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664466.991129:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664466.991137:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee600/0x762f55027be912c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be912bb expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.991151:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee600/0x762f55027be912c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be912bb expref: 14 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.991159:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ee600/0x762f55027be912c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be912bb expref: 14 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664466.991166:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee600, rc 0) 00000100:00100000:0.0:1788664466.991206:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222252672:12345-0@lo:101:mount.lustre.0 Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.991213:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788664466.991281:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664466.991291:0:15063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c12ebc00/0x762f55027be912bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912c2 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664466.991299:0:15063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c12ebc00/0x762f55027be912bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be912c2 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664466.991959:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788664466.992789:0:15063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664466.993047:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788664466.993077:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788664466.993093:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788664466.993118:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788664466.993135:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788664466.993151:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788664466.993182:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788664466.993187:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788664466.993250:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664466.993298:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664466.993361:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aa540 going to sleep for 11 seconds 00000100:00100000:0.0:1788664466.994133:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252800 00000100:00100000:0.0:1788664466.994145:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252800 00000100:00100000:0.0:1788664466.994260:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788664466.994271:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222252800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664466.994844:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222252800:12345-0@lo:501:mount.lustre.0 Request processed in 574us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664466.994865:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788664466.995300:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664466.995391:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664466.995437:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664466.999028:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222252928 00000100:00100000:1.0:1788664466.999043:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222252928 00000100:00100000:1.0:1788664466.999106:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788664466.999116:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222252928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664466.999476:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.001972:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222252928:12345-0@lo:503:mount.lustre.0 Request processed in 2849us (6525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.001986:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788664467.002082:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222252928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788664467.003985:0:15063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788664467.004079:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664467.004151:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664467.004263:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664467.004603:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253056 00000100:00100000:3.0:1788664467.004612:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253056 00000100:00100000:3.0:1788664467.004665:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788664467.004675:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222253056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664467.004907:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222253056:12345-0@lo:502:mount.lustre.0 Request processed in 233us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664467.004916:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788664467.005070:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664467.005306:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788664467.005441:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788664467.005481:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788664467.005649:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788664467.005701:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788664467.005802:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788664467.005884:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788664467.005924:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788664467.005959:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788664467.006008:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788664467.006043:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788664467.006099:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788664467.006137:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664467.006192:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664467.006306:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.006427:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253184 00000100:00100000:1.0:1788664467.006433:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253184 00000100:00100000:1.0:1788664467.006617:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788664467.006628:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222253184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664467.006963:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222253184:12345-0@lo:502:mount.lustre.0 Request processed in 337us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.006971:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788664467.007049:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664467.007119:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788664467.007130:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788664467.008219:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788664467.008228:0:15077:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788664467.008234:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664467.008242:0:15077:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788664467.008248:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788664467.008269:0:15077:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b68f8188000) 00000020:00000080:1.0:1788664467.008292:0:15077:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788664467.008298:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788664467.008391:0:15077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68f85c2800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788664467.008398:0:15077:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788664467.008406:0:15077:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x762f55027be912d0 00010000:00010000:1.0:1788664467.013947:0:15077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788664467.014483:0:15077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788664467.017265:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788664467.024332:0:15077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788664467.024373:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664467.024380:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664467.024382:0:15077:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788664467.024387:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788664467.024396:0:15077:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788664467.024398:0:15077:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788664467.024400:0:15077:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788664467.024401:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788664467.024404:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664467.024405:0:15077:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788664467.024408:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664467.024411:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664467.024412:0:15077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788664467.024415:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788664467.024417:0:15077:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788664467.024419:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664467.024422:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664467.024423:0:15077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788664467.024426:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788664467.024428:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664467.024429:0:15077:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788664467.024432:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788664467.024506:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788664467.024510:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788664467.024511:0:15077:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788664467.024514:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788664467.026624:0:15063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788664467.026670:0:15063:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788664467.026693:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c12ebc00/0x762f55027be912bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912c2 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.026707:0:15063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c12ebc00/0x762f55027be912bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912c2 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664467.026716:0:15063:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68f85c2800 from 1 10000000:01000000:0.0:1788664467.026719:0:15063:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664467.026761:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.026767:0:15063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.026785:0:15063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664467.026807:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664467.026889:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664467.026939:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f039c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.026954:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253312 00000100:00100000:1.0:1788664467.026962:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253312 00000100:00100000:1.0:1788664467.027010:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788664467.027019:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+14:15063:x1875550222253312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664467.027034:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664467.027045:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be912d7 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.027068:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be912d7 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.027080:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be912d7 expref: 15 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.027089:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2800, rc 0) 00000100:00100000:1.0:1788664467.027130:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253312:12345-0@lo:101:mount.lustre.0 Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.027136:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788664467.027519:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664467.027534:0:15063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.027544:0:15063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664467.028067:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788664467.028464:0:15063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664467.028685:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788664467.028730:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788664467.028789:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788664467.028795:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788664467.028862:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664467.028908:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664467.028953:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664467.028980:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253440 00000100:00100000:0.0:1788664467.028985:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253440 00000100:00100000:0.0:1788664467.029033:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788664467.029040:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664467.029227:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253440:12345-0@lo:501:mount.lustre.0 Request processed in 187us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664467.029235:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788664467.029273:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664467.029298:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664467.029338:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664467.029377:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664467.029390:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253568 00000100:00100000:3.0:1788664467.029394:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253568 00000100:00100000:3.0:1788664467.029423:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788664467.029431:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788664467.029697:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253568:12345-0@lo:503:mount.lustre.0 Request processed in 266us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664467.029715:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788664467.029759:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788664467.031040:0:15063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664467.031116:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664467.031177:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664467.031248:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e65f83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.031975:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253696 00000100:00100000:1.0:1788664467.031987:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253696 00000100:00100000:1.0:1788664467.032025:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788664467.032034:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664467.032361:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253696:12345-0@lo:502:mount.lustre.0 Request processed in 310us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.032378:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788664467.033030:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788664467.033923:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788664467.033993:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788664467.034044:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788664467.034089:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788664467.034116:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788664467.034157:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788664467.034255:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788664467.034294:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788664467.034905:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664467.034981:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664467.035022:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68e65f83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664467.037028:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253824 00000100:00100000:2.0:1788664467.037042:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253824 00000100:00100000:2.0:1788664467.037097:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788664467.037107:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664467.037378:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253824:12345-0@lo:502:mount.lustre.0 Request processed in 272us (2396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664467.037387:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788664467.037624:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788664467.039488:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788664467.039518:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788664467.041061:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664467.041074:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664467.041077:0:15081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788664467.041087:0:15081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68f85c2800 00000020:00000080:2.0:1788664467.041089:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788664467.041098:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664467.041101:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664467.041102:0:15081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788664467.041105:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664467.041107:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664467.041113:0:15081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788664467.041119:0:15081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b68f85c2800 00000020:00000080:2.0:1788664467.041121:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788664467.041192:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664467.041195:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664467.041197:0:15081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788664467.041199:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788664467.041202:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664467.041204:0:15081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788664467.041207:0:15081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b68f85c2800 00000020:00000080:2.0:1788664467.041210:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788664467.041246:0:15081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788664467.041249:0:15081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664467.041250:0:15081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788664467.041253:0:15081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788664467.041813:0:15063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788664467.041850:0:15063:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664467.041874:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.041887:0:15063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788664467.041929:0:15063:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788664467.041932:0:15063:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff9b68f85c2800 10000000:01000000:1.0:1788664467.041935:0:15063:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b68f85c2800 10000000:01000000:1.0:1788664467.041939:0:15063:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788664467.041944:0:15063:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b68f85c2800 from 1 10000000:01000000:1.0:1788664467.041946:0:15063:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788664467.041981:0:15063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68d15f3c00/0x762f55027be912e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.041989:0:15063:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68d15f3c00/0x762f55027be912e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.042000:0:15063:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68d15f3c00/0x762f55027be912e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664467.042021:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788664467.042089:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.042126:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222253952 00000100:00100000:1.0:1788664467.042132:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222253952 00000100:00100000:1.0:1788664467.042165:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664467.042173:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222253952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664467.042197:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664467.042211:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68d15f3400/0x762f55027be912ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be912e5 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.042234:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68d15f3400/0x762f55027be912ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be912e5 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.042244:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68d15f3400/0x762f55027be912ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be912e5 expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.042252:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3400, rc 0) 00000100:00100000:1.0:1788664467.042281:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15063:x1875550222253952:12345-0@lo:101:mount.lustre.0 Request processed in 108us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.042287:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788664467.044793:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.044856:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222253952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788664467.044882:0:15063:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68d15f3c00/0x762f55027be912e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912ec expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.044895:0:15063:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68d15f3c00/0x762f55027be912e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be912ec expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664467.045548:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788664467.047294:0:15063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664467.050104:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788664467.050175:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788664467.052718:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788664467.053766:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788664467.054738:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788664467.054903:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788664467.054940:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788664467.054967:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788664467.055006:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788664467.055034:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788664467.055060:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788664467.055122:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788664467.055150:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788664467.056284:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788664467.057044:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788664467.057086:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788664467.057122:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788664467.057169:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788664467.057310:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788664467.057394:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788664467.057442:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788664467.057492:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788664467.057530:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788664467.057578:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788664467.057614:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788664467.057670:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788664467.057717:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788664467.057774:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788664467.057881:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788664467.057889:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788664467.057992:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664467.058067:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.065833:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357600 going to sleep for 11 seconds 00000100:00100000:2.0:1788664467.068743:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254080 00000100:00100000:2.0:1788664467.068759:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254080 00000100:00100000:2.0:1788664467.068828:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788664467.068839:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15063:x1875550222254080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664467.069369:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664467.069418:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664467.069484:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.069520:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254208 00000100:00100000:1.0:1788664467.069524:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254208 00000100:00100000:1.0:1788664467.069548:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788664467.069555:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15063:x1875550222254208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664467.069692:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15063:x1875550222254208:12345-0@lo:503:mount.lustre.0 Request processed in 137us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.069701:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788664467.069748:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.069760:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788664467.070261:0:15063:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788664467.070318:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664467.070373:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.070396:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254336 00000100:00100000:1.0:1788664467.070401:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254336 00000100:00100000:1.0:1788664467.070425:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788664467.070431:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15063:x1875550222254336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664467.070590:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15063:x1875550222254336:12345-0@lo:502:mount.lustre.0 Request processed in 158us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.070597:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788664467.070631:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.070650:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664467.070854:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788664467.070899:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788664467.070928:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788664467.070983:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788664467.071021:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788664467.071077:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788664467.071115:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788664467.071147:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788664467.071194:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788664467.071230:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788664467.071262:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788664467.071320:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788664467.071377:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788664467.071412:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788664467.071461:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788664467.071497:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788664467.071530:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788664467.071575:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788664467.071612:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788664467.071645:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788664467.071691:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788664467.071729:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788664467.071764:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788664467.071809:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788664467.071859:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788664467.071891:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788664467.071936:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788664467.071985:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788664467.072020:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788664467.072069:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788664467.072105:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788664467.072153:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788664467.072187:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788664467.072234:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788664467.072269:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788664467.072316:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788664467.072375:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788664467.072410:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788664467.072476:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788664467.072515:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788664467.072555:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664467.072615:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.072658:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254464 00000100:00100000:1.0:1788664467.072664:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254464 00000100:00100000:1.0:1788664467.072701:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788664467.072708:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15063:x1875550222254464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664467.073467:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15063:x1875550222254080:12345-0@lo:501:mount.lustre.0 Request processed in 4618us (15387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664467.073478:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788664467.078966:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c5357600 going to sleep for 11 seconds 00000100:00100000:1.0:1788664467.086964:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15063:x1875550222254464:12345-0@lo:502:mount.lustre.0 Request processed in 14244us (14338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.086980:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788664467.099784:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664467.099980:0:15063:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788664467.099998:0:15063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788664467.105233:0:15086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788664467.105252:0:15086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b68f9fc0000) 00000020:00000080:3.0:1788664467.105275:0:15086:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788664467.105434:0:15086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b68f85c2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788664467.105439:0:15086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b68f85c2800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788664467.105442:0:15086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b68f85c2800 3 00010000:00080000:3.0:1788664467.105586:0:15086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b67c6c41800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.114@tcp at head 00010000:00010000:1.0:1788664467.107268:0:15086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788664467.107527:0:15086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788664467.107559:0:15086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788664467.107570:0:15086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x762f55027be912fa 00000100:00080000:1.0:1788664467.107579:0:15086:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788664467.107585:0:15086:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b67c6c41800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664467.107618:0:15086:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722ce00 x1875550222254592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664467.107654:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875550222254592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664467.107714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.107771:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254592 00000100:00100000:1.0:1788664467.107777:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254592 00000100:00100000:1.0:1788664467.107813:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664467.107820:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1875550222254592:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788664467.107842:0:14382:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:1.0:1788664467.107868:0:14382:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x762f55027be91301 00000004:00100000:1.0:1788664467.107881:0:14382:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788664467.107905:0:14382:0:(import.c:65:import_set_state_nolock()) ffff9b68f85dc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664467.107944:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875550222254592:12345-0@lo:38:llog_process_th.0 Request processed in 124us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.107951:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788664467.107982:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b67c722ce00 x1875550222254592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664467.107992:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664467.107999:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788664467.108004:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788664467.108008:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664467.108010:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b67c6c41800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664467.108015:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3306:1875550222254592:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788664467.108030:0:15086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788664467.108048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664467.108052:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664467.108055:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664467.108058:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788664467.108089:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222254720:0@lo:400:kworker.0 00000100:00100000:1.0:1788664467.108117:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.108148:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254720 00000100:00100000:1.0:1788664467.108152:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254720 00000100:00100000:1.0:1788664467.108173:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664467.108179:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222254720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664467.108208:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222254720:12345-0@lo:400:kworker.0 Request processed in 30us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.108214:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788664467.108232:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b67c722ce00 x1875550222254720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664467.108241:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222254720:0@lo:400:kworker.0 00000040:00080000:1.0:1788664467.111627:0:15086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788664467.115787:0:15063:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788664467.115838:0:15063:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788664467.115865:0:15063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68d15f3c00/0x762f55027be912e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912ec expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.115891:0:15063:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68d15f3c00/0x762f55027be912e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be912ec expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788664467.115938:0:15063:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788664467.115941:0:15063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664467.115942:0:15063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664467.115943:0:15063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664467.115945:0:15063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664467.115946:0:15063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664467.115948:0:15063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664467.115949:0:15063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664467.115951:0:15063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788664467.115954:0:15063:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788664467.115956:0:15063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788664467.115958:0:15063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664467.115959:0:15063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664467.115960:0:15063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664467.115961:0:15063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664467.115963:0:15063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664467.115964:0:15063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664467.115965:0:15063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664467.115966:0:15063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788664467.115994:0:15063:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788664467.116014:0:15063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254848:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788664467.116084:0:15063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664467.116122:0:15063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d1b88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664467.116885:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254848 00000100:00100000:2.0:1788664467.116895:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254848 00000100:00100000:2.0:1788664467.116947:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788664467.116956:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15063:x1875550222254848:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664467.116993:0:14374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788664467.117007:0:14374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788664467.177859:0:14374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788664467.177880:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788664467.178121:0:14396:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788664467.178126:0:14396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788664467.178151:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.178172:0:14396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9126e expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.178180:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.178225:0:14396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9126e expref: 16 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664467.178241:0:14396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9126e expref: 16 pid: 14373 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664467.178258:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14396:1875550222254976:0@lo:104: 00000100:00100000:0.0:1788664467.178380:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664467.178525:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222254976 00000100:00100000:1.0:1788664467.178535:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222254976 00000100:00100000:1.0:1788664467.178586:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664467.178595:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14396:x1875550222254976:12345-0@lo:104: 00010000:00010000:1.0:1788664467.178608:0:14364:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664467.178666:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788664467.178672:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14396:x1875550222254976:12345-0@lo:104: Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664467.178680:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788664467.179104:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f03540 going to sleep for 11 seconds 00000100:00100000:0.0:1788664467.179132:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14396:1875550222254976:0@lo:104: 00010000:00010000:0.0:1788664467.179154:0:14396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.179751:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664467.179761:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.179782:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1788664467.179786:0:14369:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.179817:0:14369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788664467.179825:0:14369:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788664467.179831:0:14369:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788664467.179872:0:14369:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.179880:0:14369:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788664467.179913:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.179921:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c12eb000/0x762f55027be9126e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91275 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.179948:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664467.179950:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664467.179952:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664467.179960:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664467.179974:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3307:1875550222255104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788664467.180020:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664467.180084:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222255104 00000100:00100000:3.0:1788664467.180091:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222255104 00010000:00010000:3.0:1788664467.180114:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9126e expref: 17 pid: 14373 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664467.180141:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664467.180155:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:3307:x1875550222255104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664467.180167:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664467.180173:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9126e expref: 17 pid: 14373 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180185:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9126e expref: 17 pid: 14373 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180199:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68d15f2c00/0x762f55027be91275 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9126e expref: 17 pid: 14373 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180213:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180221:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664467.180234:0:14367:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002108088s 00010000:00010000:3.0:1788664467.180239:0:14367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180247:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180254:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180261:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180266:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664467.180276:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180284:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180307:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664467.180318:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664467.180398:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3307:x1875550222255104:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664467.180406:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664467.180437:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3307:1875550222255104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788664467.180492:0:14396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664467.180501:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664467.180508:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ee800/0x762f55027be91308 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664467.200584:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:15063:x1875550222254848:12345-0@lo:253:mount.lustre.0 Request processed in 83618us (84488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664467.200599:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788664467.200679:0:15063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15063:1875550222254848:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788664467.200695:0:15063:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788664467.200698:0:15063:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788664467.200700:0:15063:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788664467.200701:0:15063:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788664467.200702:0:15063:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788664467.200704:0:15063:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788664467.200705:0:15063:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788664467.200707:0:15063:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788664467.200709:0:15063:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788664467.200710:0:15063:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788664467.200724:0:15063:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788664467.209899:0:15063:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664467.210073:0:15063:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788664467.210234:0:15063:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664467.210749:0:15063:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788664467.210915:0:15063:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788664467.211137:0:15063:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788664467.214382:0:15063:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788664467.235141:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788664467.330065:0:15063:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788664467.330075:0:15063:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788664467.330122:0:15063:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788664467.330189:0:15063:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788664467.330209:0:15063:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788664467.330239:0:15063:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788664468.259321:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788664468.576403:0:14377:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788664468.576413:0:14377:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68dff20800 from 7 10000000:01000000:0.0:1788664468.576438:0:14377:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788664468.576491:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664468.576503:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664468.576515:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664468.576541:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222255232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664468.576620:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664468.576682:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b67c4b9c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664468.576757:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222255232 00000100:00100000:1.0:1788664468.576767:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222255232 00000100:00100000:1.0:1788664468.576840:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664468.576850:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+15:14377:x1875550222255232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664468.576865:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664468.576880:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9130f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664468.576904:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9130f expref: 16 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664468.576915:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9130f expref: 16 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664468.576924:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3a00, rc 0) 00000100:00100000:1.0:1788664468.576971:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:14377:x1875550222255232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664468.576978:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788664468.577025:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222255232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664468.577040:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664468.577049:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664468.577102:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222255360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788664468.577133:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664468.577161:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f40600 going to sleep for 11 seconds 00000100:00100000:0.0:1788664468.577227:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222255360 00000100:00100000:0.0:1788664468.577232:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222255360 00000100:00100000:0.0:1788664468.577264:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788664468.577272:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:14377:x1875550222255360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788664468.577287:0:14373:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788664468.577306:0:14373:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788664468.577309:0:14373:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788664468.577427:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:14377:x1875550222255360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664468.577436:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788664468.577513:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222255360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788664468.577580:0:14377:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788664468.577588:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664468.577596:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664469.279637:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664470.304555:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664471.330050:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664472.354656:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788664472.354736:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664472.354740:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788664472.354742:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664472.354746:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788664472.354801:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222255744:0@lo:400:kworker.0 00000100:00100000:1.0:1788664472.354868:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664472.354941:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222255744 00000100:00100000:1.0:1788664472.354949:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222255744 00000100:00100000:1.0:1788664472.355009:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664472.355018:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222255744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664472.355069:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222255744:12345-0@lo:400:kworker.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664472.355076:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788664472.355119:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b67c722f100 x1875550222255744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664472.355133:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222255744:0@lo:400:kworker.0 00000100:00100000:2.0:1788664472.355267:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222255488:0@lo:400:kworker.0 00000100:00100000:2.0:1788664472.355304:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664472.355338:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664472.355366:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222255616:0@lo:400:kworker.0 00000100:00100000:2.0:1788664472.355392:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664472.355429:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222255488 00000100:00100000:2.0:1788664472.355433:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222255488 00000100:00100000:2.0:1788664472.355459:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788664472.355465:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3309:x1875550222255488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664472.355499:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3309:x1875550222255488:12345-0@lo:400:kworker.0 Request processed in 33us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664472.355505:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788664472.355534:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222255616 00000100:00100000:2.0:1788664472.355537:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222255616 00000100:00100000:2.0:1788664472.355569:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664472.355575:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222255616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664472.355603:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222255616:12345-0@lo:400:kworker.0 Request processed in 29us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664472.355608:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788664472.355637:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b67c722ed80 x1875550222255616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664472.355647:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222255616:0@lo:400:kworker.0 00000100:00100000:2.0:1788664472.355656:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222255488:0@lo:400:kworker.0 00000100:00080000:3.0:1788664472.365581:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788664473.377487:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788664473.636780:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788664474.400144:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788664474.514951:0:15430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788664475.423502:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664476.319569:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664461/real 1788664461] req@ffff9b67c722dc00 x1875550222251520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664476 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664476.319600:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b67c722dc00 x1875550222251520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664476 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664476.319630:0:3306:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788664461/real 1788664461] req@ffff9b67c722c700 x1875550222251392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664476 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788664476.319643:0:3306:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b67c722c700 x1875550222251392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788664476 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788664476.319663:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664476.319683:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788664476.319687:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222251520:0@lo:8:kworker.0 00000100:00080000:2.0:1788664476.319693:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68e6673800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788664476.319698:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788664476.319700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222251392:0@lo:8:kworker.0 00000100:00080000:1.0:1788664476.319900:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664476.319905:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788664476.319907:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b68e6673800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664476.319912:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788664476.319919:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788664476.319927:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b68e6673800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664476.319947:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722fb80 x1875550222256000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788664476.319962:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664476.319965:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788664476.319966:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664476.319969:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788664476.319971:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788664476.319974:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b68f8d65000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664476.319985:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722c700 x1875550222256128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664476.320047:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222255872:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.320125:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.320184:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222256256:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.320215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.320236:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664476.320241:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222256384:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.320275:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.320307:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222255872 00000100:00100000:1.0:1788664476.320314:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222255872 00000100:00100000:1.0:1788664476.320380:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788664476.320390:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3308:x1875550222255872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.320437:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3308:x1875550222255872:12345-0@lo:400:kworker.0 Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.320444:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788664476.320476:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256256 00000100:00100000:1.0:1788664476.320480:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256256 00000100:00100000:1.0:1788664476.320505:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256384 00000100:00100000:1.0:1788664476.320508:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256384 00000100:00100000:1.0:1788664476.320534:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664476.320541:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222256256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.321056:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222256256:12345-0@lo:400:kworker.0 Request processed in 513us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.321063:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664476.321079:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664476.321086:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222256384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.321244:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222256384:12345-0@lo:400:kworker.0 Request processed in 159us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664476.321251:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788664476.321281:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664476.321308:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222255872:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.321332:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222256000:0@lo:8:kworker.0 00010000:00080000:3.0:1788664476.321434:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b67c722ce00 x1875550222256384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664476.321463:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222256384:0@lo:400:kworker.0 00010000:00080000:3.0:1788664476.321480:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b67c722dc00 x1875550222256256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664476.321489:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222256256:0@lo:400:kworker.0 00000100:00100000:1.0:1788664476.321659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.321758:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222256128:0@lo:8:kworker.0 00000100:00100000:1.0:1788664476.321784:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664476.325205:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256000 00000100:00100000:0.0:1788664476.325222:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256000 00000100:00100000:0.0:1788664476.325284:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256128 00000100:00100000:0.0:1788664476.325288:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256128 00000100:00100000:0.0:1788664476.325315:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664476.325324:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875550222256000:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788664476.325377:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1788664476.325410:0:15064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be9131d 00002000:00100000:0.0:1788664476.325427:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b68c8643800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788664476.325432:0:15064:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788664476.325435:0:15064:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788664476.325940:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788664476.325972:0:15064:0:(import.c:65:import_set_state_nolock()) ffff9b68c8640000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788664476.326131:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875550222256000:12345-0@lo:8:kworker.0 Request processed in 807us (4471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664476.326141:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664476.326164:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664476.326169:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875550222256128:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788664476.326183:0:15064:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788664476.326212:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875550222256128:12345-0@lo:8:kworker.0 Request processed in 42us (4427us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788664476.326219:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788664476.329220:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b67c722fb80 x1875550222256000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664476.329238:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788664476.329250:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788664476.329259:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788664476.329265:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788664476.329269:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68e6673800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788664476.330263:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788664476.330278:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222256000:0@lo:8:kworker.0 00000100:00080000:3.0:1788664476.330313:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788664476.330318:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788664476.330321:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222256128:0@lo:8:kworker.0 00000004:00080000:1.0:1788664476.330427:0:14402:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788664476.330871:0:14402:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 510314528346ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788664476.334751:0:14403:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788664476.334781:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f06680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14403:1875550222256640:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788664476.334856:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664476.334887:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d1eced80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664476.334907:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222256512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664476.334931:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664476.334976:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256640 00000100:00100000:2.0:1788664476.334983:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256640 00000100:00100000:2.0:1788664476.335034:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788664476.335043:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14403:x1875550222256640:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788664476.335745:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256512 00000100:00100000:0.0:1788664476.335753:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256512 00000100:00100000:0.0:1788664476.335792:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664476.335800:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222256512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664476.335829:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664476.335901:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222256512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664476.335909:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788664476.338066:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788664476.347744:0:15067:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788664476.347754:0:15067:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788664476.347759:0:15067:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:3.0:1788664476.355467:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68e7f05f80 x1875550222256512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788664476.355497:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222256512:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1788664476.363055:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.363070:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.363088:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.363093:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.363101:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.363120:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.363131:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.363140:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.363162:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664476.365119:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664476.365132:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.365145:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eba00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664476.365150:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.365162:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.365186:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.365195:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021ea9ca9/0x762f55027be91324 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.365217:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.365219:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.365221:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.370963:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.370980:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371000:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.371005:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.371013:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371041:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371052:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371060:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371140:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788664476.371936:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.371945:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371957:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.371961:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.371965:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371977:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.371985:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.372003:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.373604:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664476.373619:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.373634:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664476.373638:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.373668:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.373688:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.373695:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004c2804c/0x762f55027be9132b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.374660:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664476.374669:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.374681:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664476.374686:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.374695:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.374712:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.374796:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.374797:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.374814:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.375388:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788664476.375398:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ad2dfc/0x762f55027be91332 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664476.376164:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.376172:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376186:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.376191:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.376198:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376211:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376220:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376228:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376260:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664476.376272:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.376278:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376285:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.376289:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376298:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376312:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376320:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a46a85e0/0x762f55027be91339 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376336:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.376337:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.376363:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.376767:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.376774:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376782:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.376791:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.376796:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376806:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376814:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376831:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376846:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664476.376856:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.376859:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376866:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ea000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.376870:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376876:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376886:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376905:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000471ffaad/0x762f55027be91340 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.376919:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.376921:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.376922:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.377306:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.377313:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377321:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.377325:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.377329:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377338:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377375:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377383:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377397:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664476.377405:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.377414:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377421:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eae00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.377424:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377432:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377443:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377450:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000765eff25/0x762f55027be91347 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377462:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.377464:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.377465:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.377898:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.377905:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377914:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.377918:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.377922:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377944:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377953:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377960:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377975:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664476.377984:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.377988:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.377994:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.377998:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378006:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378016:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378024:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032fc0e17/0x762f55027be9134e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378045:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.378047:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.378049:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.378473:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.378479:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378487:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.378490:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.378495:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378504:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378511:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378518:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378534:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664476.378542:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.378546:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378564:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eac00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.378568:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378575:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378586:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378594:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c928923/0x762f55027be91355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.378608:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.378610:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.378612:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.380314:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.382232:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.382246:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.382264:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.382269:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.382277:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.382292:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.382311:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.382319:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.382454:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788664476.383216:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.383225:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.383236:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.383240:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.383245:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.383256:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.383265:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.383272:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383399:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664476.383407:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383416:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12ebe00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664476.383421:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383430:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383447:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383455:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e5921ff/0x762f55027be9135c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383477:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664476.383480:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383487:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c12eb000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664476.383490:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383510:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383522:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.383905:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.383908:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.383909:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.384165:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788664476.384172:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000006426ad/0x762f55027be91363 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664476.385192:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.385203:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.385216:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.385221:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.385226:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.385238:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.385247:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.385254:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.385786:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664476.385793:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.385802:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ac00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664476.385807:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.385816:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.385843:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.386398:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.386402:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.386404:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.386665:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788664476.386675:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be9136a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664476.388750:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.388763:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.388780:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.388785:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.388792:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.388806:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.388815:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.388833:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.392428:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664476.392445:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.392474:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664476.392479:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.392491:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.392512:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664476.393365:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.393370:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.393506:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788664476.393516:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be91371 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664476.394606:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.394616:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.394642:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.394647:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.394655:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.394670:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.394680:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.394688:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.395337:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664476.395363:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.395385:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512be00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664476.395390:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.395401:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.395420:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.395430:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664476.395432:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664476.395433:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664476.397393:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.397721:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788664476.397731:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025d4704a/0x762f55027be91378 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664476.398901:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.398913:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.398928:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.398933:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.398940:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.399498:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.399701:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.399788:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.399796:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.401169:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664476.401636:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664476.401647:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.401660:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512bc00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.401664:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.401676:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.401702:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.401723:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af0e6706/0x762f55027be9137f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.401747:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.401749:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.401751:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.402518:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.402783:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.402797:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.402802:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.402808:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.402835:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.402845:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.402865:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.402922:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788664476.403580:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.403588:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.403599:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.403602:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.403607:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.403617:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.403626:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.403632:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408305:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664476.408321:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408335:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512aa00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.408362:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408375:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408396:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408405:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d1a110d/0x762f55027be91386 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408436:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664476.408440:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408447:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ae00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.408450:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408458:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408483:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.408491:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.408493:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.408495:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.411093:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788664476.411107:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dd7d577/0x762f55027be9138d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788664476.411822:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.411832:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.411846:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.411851:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.411857:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.411871:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.411881:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.411889:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.411911:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788664476.412338:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.412378:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412388:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.412391:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.412403:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412415:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412422:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412431:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412440:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788664476.412838:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.412845:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412853:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.412857:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.412860:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412870:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412878:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412896:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.412905:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788664476.413304:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.413310:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413318:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.413321:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.413325:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413334:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413373:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413380:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413390:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788664476.413755:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.413762:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413776:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.413779:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.413784:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413794:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413802:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413820:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.413829:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788664476.414462:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788664476.414471:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414481:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.414486:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414496:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414524:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414533:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c897ec/0x762f55027be91394 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414553:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788664476.414556:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414574:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.414577:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414584:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414593:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414599:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003243e7d3/0x762f55027be9139b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414609:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788664476.414612:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414617:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.414620:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414626:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414634:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414645:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea6f4085/0x762f55027be913a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414657:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788664476.414660:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414666:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.414669:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414676:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414685:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414692:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009adbb166/0x762f55027be913a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414714:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664476.414717:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414724:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.414734:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414741:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414750:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414757:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b56cf91/0x762f55027be913b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.414770:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.414772:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.414774:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664476.415263:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.417944:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.418153:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418172:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.418176:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.418184:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418199:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418223:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418230:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418253:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788664476.418792:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.418799:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418821:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.418825:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.418829:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418840:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418848:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418856:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418889:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788664476.418905:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664476.418911:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418919:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ba00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.418923:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418933:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.418949:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419223:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bef86324/0x762f55027be913b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419245:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.419249:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419256:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.419260:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419279:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419291:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419298:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db685a4/0x762f55027be913be lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419314:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.419316:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.419318:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.419929:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.419936:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.419946:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.419949:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.420209:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420225:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420233:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420254:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420273:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664476.420284:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.420289:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420296:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.420301:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420309:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420321:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420328:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3f2cc4/0x762f55027be913c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.420371:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.420374:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.420375:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.420799:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.421148:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.421163:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421174:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.421178:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.421183:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421194:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421202:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421209:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421225:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664476.421234:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664476.421238:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421245:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664476.421249:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421257:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421276:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421283:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c8f099d/0x762f55027be913cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.421299:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.421301:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664476.421303:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.422455:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.422464:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.422475:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.422479:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.422484:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.422495:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.422504:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.422512:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.422548:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664476.422845:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664476.422852:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.422861:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664476.422865:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.422874:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.422889:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.422902:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bed53b1/0x762f55027be913d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.422919:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.422920:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.422922:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788664476.423308:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788664476.423315:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.423324:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788664476.423327:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788664476.423332:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.423452:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.423462:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.423468:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664476.423521:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788664476.423789:0:15067:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1788664476.423904:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14403:x1875550222256640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 88859us (89044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664476.423914:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664476.424220:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f06680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14403:1875550222256640:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788664476.424236:0:14403:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788664476.424284:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14403:1875550222256768:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788664476.424320:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664476.424385:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788664476.424449:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256768 00000100:00100000:2.0:1788664476.424464:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256768 00000100:00100000:2.0:1788664476.424503:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664476.424519:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14403:x1875550222256768:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788664476.424564:0:15066:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1788664476.429164:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664476.429181:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.429197:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ac00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664476.429202:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.429215:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.429238:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664476.429265:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e2f8177/0x762f55027be913da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664476.430137:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.430143:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664476.430145:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788664476.430881:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788664476.448716:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664476.453871:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14403:x1875550222256768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29353us (29542us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788664476.453890:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664476.454368:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14403:1875550222256768:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788664476.454385:0:14403:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788664477.472013:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788664477.698966:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788664477.699023:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1788664478.497394:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664479.520149:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664480.548551:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788664481.571263:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664481.571270:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788664481.571274:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664481.571282:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:3.0:1788664481.571288:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788664481.571295:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b68f8d65000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664481.571315:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68e7edd880 x1875550222257152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788664481.571412:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222256896:0@lo:400:kworker.0 00000100:00100000:3.0:1788664481.571484:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664481.571541:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788664481.571548:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222257408:0@lo:400:kworker.0 00000100:00100000:3.0:1788664481.571574:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664481.571615:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222257024:0@lo:400:kworker.0 00000100:00100000:3.0:1788664481.571641:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664481.571674:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664481.571679:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222257280:0@lo:400:kworker.0 00000100:00100000:3.0:1788664481.571701:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664481.571723:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222257152:0@lo:8:kworker.0 00010000:00010000:1.0:1788664481.571951:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664481.571965:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257408 00000100:00100000:1.0:1788664481.571973:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257408 00000100:00100000:1.0:1788664481.572023:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257280 00000100:00100000:1.0:1788664481.572026:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257280 00000100:00100000:1.0:1788664481.572043:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664481.572052:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222257408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.572098:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222257408:12345-0@lo:400:kworker.0 Request processed in 48us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.572114:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664481.572141:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664481.572148:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222257280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.572183:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222257280:12345-0@lo:400:kworker.0 Request processed in 36us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664481.572189:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664481.572212:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222257536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664481.572235:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788664481.572265:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68e7ede680 x1875550222257408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664481.572279:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222257408:0@lo:400:kworker.0 00000100:00080000:1.0:1788664481.572304:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664481.572325:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68e7ede300 x1875550222257280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664481.572332:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222257280:0@lo:400:kworker.0 00000100:00100000:3.0:1788664481.572465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664481.572504:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222256896 00000100:00100000:3.0:1788664481.572508:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222256896 00000100:00100000:3.0:1788664481.572533:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664481.572541:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3308:x1875550222256896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664481.572574:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3308:x1875550222256896:12345-0@lo:400:kworker.0 Request processed in 34us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664481.572580:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788664481.572618:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257024 00000100:00100000:3.0:1788664481.572622:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257024 00000100:00100000:3.0:1788664481.572648:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257152 00000100:00100000:3.0:1788664481.572651:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257152 00000100:00100000:3.0:1788664481.572661:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664481.572668:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222257024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664481.572702:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222257024:12345-0@lo:400:kworker.0 Request processed in 34us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664481.572707:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664481.572718:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788664481.572722:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875550222257152:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788664481.572740:0:15067:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788664481.572914:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257536 00000100:00100000:0.0:1788664481.572919:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257536 00000100:00100000:0.0:1788664481.572962:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788664481.572969:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222257536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664481.572994:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664481.573026:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222257536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664481.573044:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788664481.574380:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664481.574420:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788664481.574439:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222257024:0@lo:400:kworker.0 00000100:00100000:1.0:1788664481.574479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222257536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664481.574489:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222256896:0@lo:400:kworker.0 00000100:00100000:2.0:1788664481.637170:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3306:x1875550222257152:12345-0@lo:8:kworker.0 Request processed in 64440us (64698us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788664481.637183:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788664481.639841:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788664481.639854:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788664481.639869:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222257152:0@lo:8:kworker.0 00010000:00010000:0.0:1788664482.591566:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788664482.600876:0:15782:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:2.0:1788664482.600880:0:15782:0:(obd_mount.c:924:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788664482.601006:0:15782:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9b67c532e800 00000020:01000004:2.0:1788664482.601023:0:15782:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788664482.601036:0:15782:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788664482.601050:0:15782:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b68e7e63380) 00000020:00000080:2.0:1788664482.601067:0:15782:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788664482.624668:0:15782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788664482.624898:0:15782:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788664482.625896:0:15782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788664482.626105:0:15782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788664482.626405:0:15782:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788664482.626743:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00100000:10000000:2.0:1788664482.626893:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:2.0:1788664482.626991:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:2.0:1788664482.627996:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:2.0:1788664482.628462:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788664482.628705:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:2.0:1788664482.628939:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:2.0:1788664482.629193:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788664482.629617:0:15782:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 451: rc = 0 00000020:00000080:2.0:1788664482.630581:0:15782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788664482.630594:0:15782:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788664482.630610:0:15782:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x762f55027be913e8 00000020:01000004:2.0:1788664482.630618:0:15782:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788664482.630639:0:15782:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788664482.630643:0:15782:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788664482.630648:0:15782:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788664482.630669:0:15782:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788664482.630673:0:15782:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788664482.645314:0:15782:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788664482.645383:0:15782:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.114@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788664482.645387:0:15782:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788664482.645389:0:15782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664482.645390:0:15782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664482.645392:0:15782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664482.645393:0:15782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664482.645394:0:15782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664482.645396:0:15782:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664482.645398:0:15782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664482.645399:0:15782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788664482.645403:0:15782:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788664482.645405:0:15782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788664482.645406:0:15782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664482.645407:0:15782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664482.645409:0:15782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664482.645410:0:15782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664482.645411:0:15782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664482.645411:0:15782:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664482.645412:0:15782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664482.645413:0:15782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788664482.645444:0:15782:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788664482.645466:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222257664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788664482.645537:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664482.645588:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59a6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664482.646076:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257664 00000100:00100000:1.0:1788664482.646084:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257664 00000100:00100000:1.0:1788664482.646156:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788664482.646173:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15782:x1875550222257664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788664482.646205:0:14373:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788664482.646208:0:14373:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788664482.646212:0:14373:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788664482.662171:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15782:x1875550222257664:12345-0@lo:253:mount.lustre.0 Request processed in 15988us (16622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.662186:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788664482.662369:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222257664:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788664482.662390:0:15782:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788664482.662394:0:15782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788664482.662396:0:15782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788664482.662397:0:15782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664482.662399:0:15782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664482.662400:0:15782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664482.662401:0:15782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664482.662403:0:15782:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788664482.662405:0:15782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664482.662406:0:15782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788664482.662428:0:15782:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b67c532e800 from lustre-OST0001 10000000:01000000:0.0:1788664482.662455:0:15782:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788664482.662458:0:15782:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788664482.662466:0:15782:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b68f818b380 local copy 00010000:00010000:0.0:1788664482.662574:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664482.662800:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222257792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664482.662845:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.662886:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664482.662959:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257792 00000100:00100000:1.0:1788664482.662967:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257792 00000100:00100000:1.0:1788664482.663017:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788664482.663026:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15782:x1875550222257792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664482.663232:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15782:x1875550222257792:12345-0@lo:501:mount.lustre.0 Request processed in 206us (386us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788664482.663239:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788664482.663498:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222257792:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788664482.663513:0:15782:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788664482.663653:0:15782:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788664482.663661:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.663682:0:15782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef600/0x762f55027be91195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9119c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664482.663707:0:15782:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b67c532e800 10000000:01000000:0.0:1788664482.663712:0:15782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788664482.663716:0:15782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788664482.663719:0:15782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664482.663724:0:15782:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788664482.663727:0:15782:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788664482.663749:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee200/0x762f55027be913ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.663756:0:15782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee200/0x762f55027be913ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.663765:0:15782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee200/0x762f55027be913ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664482.663777:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222257920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664482.663805:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.663827:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664482.664007:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222257920 00000100:00100000:3.0:1788664482.664012:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222257920 00000100:00100000:3.0:1788664482.664049:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788664482.664056:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:15782:x1875550222257920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788664482.664067:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664482.664080:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b2e00/0x762f55027be913f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be913ef expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.664101:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b2e00/0x762f55027be913f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be913ef expref: 17 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.664113:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b2e00/0x762f55027be913f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be913ef expref: 17 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.664238:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2e00, rc 0) 00000100:00100000:3.0:1788664482.664279:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222257920:12345-0@lo:101:mount.lustre.0 Request processed in 223us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.664286:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788664482.664812:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222257920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664482.664829:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee200/0x762f55027be913ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be913f6 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.664838:0:15782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee200/0x762f55027be913ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be913f6 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664482.665767:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788664482.669749:0:15782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664482.670032:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788664482.670077:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788664482.670139:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788664482.670189:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788664482.670224:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788664482.670260:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788664482.670324:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788664482.670333:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788664482.670473:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664482.670537:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.670569:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664482.670886:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258048 00000100:00100000:2.0:1788664482.670893:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258048 00000100:00100000:2.0:1788664482.670944:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788664482.670954:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664482.671322:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258048:12345-0@lo:501:mount.lustre.0 Request processed in 369us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664482.671330:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788664482.671623:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664482.671661:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664482.671700:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.671767:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788664482.671962:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258176 00000100:00100000:1.0:1788664482.671967:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258176 00000100:00100000:1.0:1788664482.672057:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788664482.672066:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664482.672469:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258176:12345-0@lo:503:mount.lustre.0 Request processed in 403us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.672581:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664482.673053:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000040:00080000:0.0:1788664482.673721:0:15782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664482.673796:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664482.673854:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.673936:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788664482.675496:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258304 00000100:00100000:2.0:1788664482.675508:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258304 00000100:00100000:0.0:1788664482.675693:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788664482.675704:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664482.676030:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258304:12345-0@lo:502:mount.lustre.0 Request processed in 328us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.676046:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788664482.676376:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664482.676646:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788664482.676705:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788664482.676742:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788664482.676792:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788664482.676829:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788664482.676864:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788664482.676912:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788664482.676963:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788664482.677021:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788664482.677070:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664482.677416:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664482.677459:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664482.677568:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258432 00000100:00100000:0.0:1788664482.677574:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258432 00000100:00100000:0.0:1788664482.677616:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788664482.677625:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664482.677795:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258432:12345-0@lo:502:mount.lustre.0 Request processed in 170us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.677803:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788664482.677886:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788664482.678395:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788664482.678407:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788664482.680027:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788664482.680037:0:15783:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788664482.680044:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788664482.680046:0:15783:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788664482.680051:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788664482.680067:0:15783:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b68e7e619c0) 00000020:00000080:2.0:1788664482.680088:0:15783:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788664482.680101:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788664482.680263:0:15783:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b67c532e800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788664482.680270:0:15783:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788664482.680277:0:15783:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x762f55027be91404 00010000:00010000:3.0:1788664482.684647:0:15783:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788664482.685243:0:15783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788664482.687587:0:15783:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788664482.689054:0:15783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788664482.689067:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664482.689074:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664482.689076:0:15783:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788664482.689085:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664482.689089:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664482.689091:0:15783:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788664482.689094:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788664482.689096:0:15783:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788664482.689098:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664482.689101:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664482.689102:0:15783:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788664482.689104:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788664482.689123:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664482.689126:0:15783:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788664482.689130:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788664482.689182:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788664482.689185:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788664482.689187:0:15783:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788664482.689191:0:15783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788664482.689477:0:15782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788664482.689504:0:15782:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788664482.689523:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee200/0x762f55027be913ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be913f6 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.689536:0:15782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee200/0x762f55027be913ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be913f6 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664482.689544:0:15782:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b67c532e800 from 1 10000000:01000000:2.0:1788664482.689547:0:15782:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788664482.689581:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.689590:0:15782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.689601:0:15782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664482.689624:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788664482.689688:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664482.689759:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664482.692039:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258560 00000100:00100000:0.0:1788664482.692052:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258560 00000100:00100000:0.0:1788664482.692135:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788664482.692148:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:15782:x1875550222258560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664482.692168:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664482.692186:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be9140b expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.692215:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be9140b expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.692227:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9140b expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.692237:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee800, rc 0) 00000100:00100000:0.0:1788664482.692316:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222258560:12345-0@lo:101:mount.lustre.0 Request processed in 171us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.692324:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788664482.695477:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788664482.695511:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.695539:0:15782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788664482.696100:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788664482.696760:0:15782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788664482.697292:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788664482.697449:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788664482.697578:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788664482.697586:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788664482.697663:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788664482.697726:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664482.697809:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c59a6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664482.701763:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258688 00000100:00100000:0.0:1788664482.701777:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258688 00000100:00100000:0.0:1788664482.701835:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788664482.701845:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222258688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664482.702151:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222258688:12345-0@lo:501:mount.lustre.0 Request processed in 307us (4424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.702160:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788664482.702601:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f06a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664482.702659:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788664482.702704:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.702741:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664482.702843:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258816 00000100:00100000:1.0:1788664482.702848:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258816 00000100:00100000:1.0:1788664482.702882:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788664482.702890:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222258816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664482.703692:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222258816:12345-0@lo:503:mount.lustre.0 Request processed in 799us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664482.703702:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788664482.704319:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788664482.705220:0:15782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788664482.705300:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664482.705994:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664482.706074:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c1254180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664482.706197:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222258944 00000100:00100000:0.0:1788664482.706203:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222258944 00000100:00100000:0.0:1788664482.706287:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788664482.706296:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222258944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664482.706578:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222258944:12345-0@lo:502:mount.lustre.0 Request processed in 282us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.706586:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788664482.706677:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222258944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664482.706941:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788664482.706994:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788664482.707045:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788664482.707080:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788664482.707131:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788664482.707178:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788664482.707214:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788664482.707250:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788664482.707286:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664482.707330:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664482.707839:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8da8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788664482.707979:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259072 00000100:00100000:3.0:1788664482.707986:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259072 00000100:00100000:3.0:1788664482.708021:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788664482.708029:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222259072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788664482.708298:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222259072:12345-0@lo:502:mount.lustre.0 Request processed in 269us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.708305:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788664482.708434:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664482.708553:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788664482.708565:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788664482.709686:0:15787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664482.709698:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664482.709701:0:15787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788664482.709707:0:15787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b67c532e800 00000020:00000080:1.0:1788664482.709710:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664482.709717:0:15787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664482.709720:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664482.709721:0:15787:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788664482.709724:0:15787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664482.709726:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664482.709727:0:15787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788664482.709731:0:15787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b67c532e800 00000020:00000080:1.0:1788664482.709733:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664482.709801:0:15787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664482.709805:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664482.709806:0:15787:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788664482.709808:0:15787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788664482.709818:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664482.709819:0:15787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788664482.709822:0:15787:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b67c532e800 00000020:00000080:1.0:1788664482.709824:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788664482.709861:0:15787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788664482.709865:0:15787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788664482.709866:0:15787:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788664482.709869:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788664482.711683:0:15782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788664482.711720:0:15782:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664482.711739:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.711752:0:15782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664482.711805:0:15782:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788664482.711808:0:15782:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff9b67c532e800 10000000:01000000:0.0:1788664482.711811:0:15782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b67c532e800 10000000:01000000:0.0:1788664482.711815:0:15782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788664482.711820:0:15782:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff9b67c532e800 from 1 10000000:01000000:0.0:1788664482.711823:0:15782:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788664482.711857:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66efc00/0x762f55027be91419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.711865:0:15782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66efc00/0x762f55027be91419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.711876:0:15782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66efc00/0x762f55027be91419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664482.711988:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788664482.712057:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.712095:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d15e0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664482.712701:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259200 00000100:00100000:0.0:1788664482.712708:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259200 00000100:00100000:0.0:1788664482.712760:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664482.712769:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222259200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664482.712783:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664482.712796:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ef000/0x762f55027be91420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be91419 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.712821:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ef000/0x762f55027be91420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be91419 expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.712832:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ef000/0x762f55027be91420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be91419 expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.712841:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef000, rc 0) 00000100:00100000:0.0:1788664482.712888:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259200:12345-0@lo:101:mount.lustre.0 Request processed in 119us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.712894:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788664482.713215:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788664482.713234:0:15782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66efc00/0x762f55027be91419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91420 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.713244:0:15782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66efc00/0x762f55027be91419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be91420 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788664482.715727:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788664482.720666:0:15782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788664482.722369:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788664482.722447:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788664482.723749:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788664482.723815:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788664482.723855:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788664482.723902:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788664482.728456:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788664482.728505:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788664482.728579:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788664482.728618:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788664482.728652:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788664482.728702:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788664482.728737:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788664482.728770:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788664482.728815:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788664482.728851:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788664482.728884:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788664482.728949:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788664482.728982:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788664482.729015:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788664482.729066:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788664482.729113:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788664482.729148:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788664482.729196:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788664482.729233:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788664482.729267:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788664482.729310:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788664482.729376:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788664482.729412:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788664482.729475:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788664482.729509:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788664482.729541:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788664482.729572:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788664482.729613:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788664482.729649:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788664482.729709:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788664482.729748:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788664482.729837:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788664482.729846:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788664482.729963:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788664482.730030:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.731529:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015480 going to sleep for 11 seconds 00000100:00100000:1.0:1788664482.732014:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259328 00000100:00100000:1.0:1788664482.732024:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259328 00000100:00100000:1.0:1788664482.732074:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664482.732084:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664482.733675:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259328:12345-0@lo:501:mount.lustre.0 Request processed in 1586us (3638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664482.733687:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788664482.734568:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788664482.734627:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788664482.734682:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664482.737038:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8da8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664482.740607:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259456 00000100:00100000:2.0:1788664482.740624:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259456 00000100:00100000:2.0:1788664482.740731:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788664482.740742:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788664482.741189:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259456:12345-0@lo:503:mount.lustre.0 Request processed in 448us (6505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664482.741197:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788664482.743722:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259456:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788664482.744376:0:15782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788664482.744465:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788664482.744540:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.744916:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015540 going to sleep for 11 seconds 00000100:00100000:1.0:1788664482.744994:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259584 00000100:00100000:1.0:1788664482.745002:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259584 00000100:00100000:1.0:1788664482.745038:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788664482.745047:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664482.748663:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259584:12345-0@lo:502:mount.lustre.0 Request processed in 3604us (4111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664482.748677:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788664482.750484:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788664482.750816:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788664482.750880:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788664482.751723:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788664482.751788:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788664482.751825:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788664482.751873:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788664482.754049:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788664482.754205:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788664482.754290:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788664482.754328:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788664482.754381:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788664482.754429:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788664482.754475:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788664482.754506:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788664482.754549:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788664482.754580:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788664482.754610:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788664482.754653:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788664482.754686:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788664482.754718:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788664482.754765:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788664482.754797:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788664482.754830:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788664482.754876:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788664482.756558:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788664482.756618:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788664482.756701:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788664482.756740:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788664482.756774:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788664482.756819:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788664482.756855:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788664482.756890:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788664482.758063:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788664482.758217:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788664482.758254:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788664482.758301:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788664482.758334:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788664482.759026:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788664482.759172:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788664482.759210:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788664482.759266:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788664482.759508:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664482.761724:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8da8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788664482.764466:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259712 00000100:00100000:2.0:1788664482.764478:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259712 00000100:00100000:2.0:1788664482.764532:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788664482.764540:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788664482.764804:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222259712:12345-0@lo:502:mount.lustre.0 Request processed in 265us (5296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664482.764812:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788664482.765412:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222259712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788664482.765530:0:15782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788664482.765547:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788664482.769581:0:15792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788664482.769598:0:15792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b68f9fc3380) 00000020:00000080:3.0:1788664482.769619:0:15792:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788664482.769723:0:15792:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b67c532e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788664482.769727:0:15792:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b67c532e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788664482.769729:0:15792:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b67c532e800 3 00010000:00080000:3.0:1788664482.769760:0:15792:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b67c5b53800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.114@tcp at head 00010000:00010000:3.0:1788664482.773839:0:15792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788664482.774198:0:15792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788664482.774239:0:15792:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788664482.774251:0:15792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x762f55027be9142e 00000100:00080000:3.0:1788664482.774261:0:15792:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788664482.774267:0:15792:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b67c5b53800 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664482.774301:0:15792:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68e7edd880 x1875550222259840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664482.774387:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875550222259840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664482.774461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788664482.775178:0:15792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788664482.775239:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788664482.775243:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788664482.775245:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788664482.775250:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:3.0:1788664482.775254:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788664482.775258:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b68f8d65000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:3.0:1788664482.775272:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b68e7edf480 x1875550222260096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788664482.775360:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259840 00000100:00100000:2.0:1788664482.775367:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259840 00000100:00100000:2.0:1788664482.775400:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664482.775408:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1875550222259840:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788664482.775446:0:14380:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788664482.775480:0:14380:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x762f55027be91435 00000004:00100000:2.0:1788664482.775495:0:14380:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788664482.775524:0:14380:0:(import.c:65:import_set_state_nolock()) ffff9b67c5982000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664482.777002:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222260096:0@lo:8:kworker.0 00000100:00100000:1.0:1788664482.777064:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.777220:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260096 00000100:00100000:0.0:1788664482.777227:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260096 00000100:00100000:0.0:1788664482.777261:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664482.777267:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875550222260096:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788664482.777317:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3306:x1875550222260096:12345-0@lo:8:kworker.0 Request processed in 49us (252us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788664482.777324:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788664482.777573:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222260352:0@lo:400:kworker.0 00000100:00100000:0.0:1788664482.777607:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664482.777680:0:14379:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788664482.777688:0:14379:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788664482.777775:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875550222259840:12345-0@lo:38:llog_process_th.0 Request processed in 2365us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664482.777782:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664482.777796:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260352 00000100:00100000:2.0:1788664482.777800:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260352 00000100:00100000:2.0:1788664482.777823:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788664482.777828:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222260352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664482.777971:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875550222260352:12345-0@lo:400:kworker.0 Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664482.777978:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788664482.778171:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68e7edd880 x1875550222259840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788664492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664482.778183:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664482.778192:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788664482.778198:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788664482.778203:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788664482.778206:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b67c5b53800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788664482.778212:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3306:1875550222259840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788664482.778235:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788664482.778239:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788664482.778242:0:3306:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788664482.778245:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222260096:0@lo:8:kworker.0 00000100:00100000:1.0:1788664482.778273:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222259968:0@lo:400:kworker.0 00000100:00100000:1.0:1788664482.778303:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664482.778394:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664482.778400:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222260224:0@lo:400:kworker.0 00000100:00100000:1.0:1788664482.778434:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664482.778464:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260224 00000100:00100000:1.0:1788664482.778469:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260224 00000100:00100000:1.0:1788664482.778490:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664482.778497:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222260224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664482.778532:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222260224:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664482.778537:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788664482.778563:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68e7ede300 x1875550222260224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664482.778573:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222260224:0@lo:400:kworker.0 00010000:00080000:0.0:1788664482.780046:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b68e7ede680 x1875550222260352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664482.780059:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3307:1875550222260352:0@lo:400:kworker.0 00000040:00080000:2.0:1788664482.780650:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788664482.780999:0:15782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788664482.781029:0:15782:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788664482.781044:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66efc00/0x762f55027be91419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91420 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.781054:0:15782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66efc00/0x762f55027be91419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be91420 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788664482.781212:0:15782:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788664482.781214:0:15782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788664482.781216:0:15782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664482.781217:0:15782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664482.781218:0:15782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664482.781220:0:15782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664482.781221:0:15782:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788664482.781223:0:15782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664482.781225:0:15782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788664482.781228:0:15782:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788664482.781230:0:15782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788664482.781231:0:15782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788664482.781233:0:15782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788664482.781234:0:15782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788664482.781235:0:15782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788664482.781236:0:15782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788664482.781236:0:15782:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788664482.781238:0:15782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788664482.781238:0:15782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788664482.781263:0:15782:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788664482.781284:0:15782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222260480:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788664482.781373:0:15782:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664482.781410:0:15782:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c6015480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664482.781520:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260480 00000100:00100000:2.0:1788664482.781527:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260480 00000100:00100000:2.0:1788664482.781566:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664482.781575:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c58c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:15782:x1875550222260480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788664482.781602:0:14374:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788664482.781615:0:14374:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788664482.784985:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222259968 00000100:00100000:3.0:1788664482.784996:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222259968 00000100:00100000:3.0:1788664482.785055:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664482.785957:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222259968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664482.786152:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222259968:12345-0@lo:400:kworker.0 Request processed in 1086us (7846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.786162:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788664482.787326:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222259968:0@lo:400:kworker.0 20000000:01000000:3.0:1788664482.819723:0:14374:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788664482.819744:0:14374:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788664482.820674:0:14396:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788664482.820682:0:14396:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788664482.820705:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.820738:0:14396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9130f expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.820747:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.820788:0:14396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9130f expref: 19 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664482.820804:0:14396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9130f expref: 19 pid: 14375 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664482.820820:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14396:1875550222260608:0@lo:104: 00000100:00100000:2.0:1788664482.820960:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664482.821004:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c617ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788664482.821155:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260608 00000100:00100000:0.0:1788664482.821164:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260608 00000100:00100000:0.0:1788664482.821227:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664482.821237:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14396:x1875550222260608:12345-0@lo:104: 00010000:00010000:0.0:1788664482.821249:0:14365:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.821301:0:14365:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788664482.821307:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:14396:x1875550222260608:12345-0@lo:104: Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.821314:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788664482.821538:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14396:1875550222260608:0@lo:104: 00010000:00010000:2.0:1788664482.821558:0:14396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.822797:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664482.822809:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.822819:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66ee000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1788664482.822823:0:14369:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.822831:0:14369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788664482.822838:0:14369:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664482.822843:0:14369:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788664482.823304:0:14369:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.823312:0:14369:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788664482.823337:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.823364:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee000/0x762f55027be9130f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91316 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.823383:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664482.823385:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664482.823387:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664482.823396:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788664482.824034:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3307:1875550222260736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664482.824510:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664482.824609:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260736 00000100:00100000:3.0:1788664482.824618:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260736 00010000:00010000:3.0:1788664482.824653:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9130f expref: 20 pid: 14375 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664482.824691:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788664482.824700:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+20:3307:x1875550222260736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664482.824713:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664482.824718:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9130f expref: 20 pid: 14375 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824741:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9130f expref: 20 pid: 14375 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824756:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68d15f3a00/0x762f55027be91316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9130f expref: 20 pid: 14375 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824771:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824779:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788664482.824793:0:14367:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004111861s 00010000:00010000:3.0:1788664482.824797:0:14367:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824804:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824810:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824817:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824823:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664482.824827:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.824835:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.827867:0:14396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664482.827886:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.828011:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.828024:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512a200/0x762f55027be9143c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664482.828045:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788664482.828148:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3307:x1875550222260736:12345-0@lo:103:ldlm_bl.0 Request processed in 3446us (3635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664482.828158:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788664482.828400:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3307:1875550222260736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788664482.829591:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c58c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:15782:x1875550222260480:12345-0@lo:253:mount.lustre.0 Request processed in 48012us (48213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664482.829603:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788664482.829677:0:15782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:15782:1875550222260480:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788664482.829691:0:15782:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788664482.829694:0:15782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788664482.829696:0:15782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788664482.829697:0:15782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788664482.829698:0:15782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788664482.829700:0:15782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788664482.829701:0:15782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788664482.829703:0:15782:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788664482.829704:0:15782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788664482.829705:0:15782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788664482.829738:0:15782:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788664482.837291:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788664482.837740:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788664482.837985:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788664482.838291:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788664482.838609:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788664482.838811:0:15782:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788664482.839928:0:15782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788664482.920924:0:15782:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788664482.921000:0:15782:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788664482.921053:0:15782:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788664482.921131:0:15782:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788664482.921147:0:15782:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788664482.921194:0:15782:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788664483.615600:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664483.873191:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788664483.999688:0:14377:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788664483.999697:0:14377:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff9b68dff20800 from 8 10000000:01000000:3.0:1788664483.999711:0:14377:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788664483.999757:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68f88b2200/0x762f55027be91443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664483.999785:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68f88b2200/0x762f55027be91443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664483.999797:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68f88b2200/0x762f55027be91443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664483.999826:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222260864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788664483.999901:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664483.999954:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788664484.000149:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260864 00000100:00100000:1.0:1788664484.000157:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260864 00000100:00100000:1.0:1788664484.000212:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788664484.000222:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:14377:x1875550222260864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664484.000243:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664484.000257:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68d15f2a00/0x762f55027be9144a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be91443 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.000279:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68d15f2a00/0x762f55027be9144a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be91443 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.000288:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68d15f2a00/0x762f55027be9144a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be91443 expref: 19 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.000296:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2a00, rc 0) 00000100:00100000:1.0:1788664484.000365:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222260864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664484.000373:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788664484.001669:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222260864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664484.001693:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68f88b2200/0x762f55027be91443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9144a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664484.001710:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68f88b2200/0x762f55027be91443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be9144a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664484.001780:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222260992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788664484.001828:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664484.001875:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664484.001924:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222260992 00000100:00100000:2.0:1788664484.001930:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222260992 00000100:00100000:2.0:1788664484.001967:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788664484.001974:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222260992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788664484.001993:0:14374:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788664484.002008:0:14374:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788664484.002011:0:14374:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788664484.002112:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222260992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664484.002120:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788664484.002201:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222260992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788664484.002253:0:14377:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788664484.002260:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68f88b2200/0x762f55027be91443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9144a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664484.002269:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68f88b2200/0x762f55027be91443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be9144a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664484.640937:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664485.667401:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664486.687818:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664486.688397:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222261120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664486.688495:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664486.688890:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222261120 00000100:00100000:3.0:1788664486.688900:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222261120 00000100:00100000:3.0:1788664486.688973:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788664486.688985:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222261120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788664486.689036:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788664486.689088:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222261120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664486.689097:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788664486.689159:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664486.694448:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222261120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788664487.712741:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788664488.223704:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788664488.223711:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788664488.223715:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788664488.223727:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b68f8d65000 using connection 192.168.202.114@tcp/0@lo 00000100:00100000:1.0:1788664488.223762:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b67c722ce00 x1875550222261504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788664488.223827:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222261760:0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.223901:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.223959:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788664488.223966:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222261248:0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.223995:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.224016:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222261888:0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224035:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.224060:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222261376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224087:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.224105:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664488.224110:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222261632:0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224131:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.224158:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222261504:0@lo:8:kworker.0 00000100:00100000:1.0:1788664488.224180:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.224209:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222261760 00000100:00100000:1.0:1788664488.224216:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222261760 00000100:00100000:1.0:1788664488.224270:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222261888 00000100:00100000:1.0:1788664488.224274:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222261888 00000100:00100000:1.0:1788664488.224300:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222261632 00000100:00100000:1.0:1788664488.224303:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222261632 00000100:00100000:1.0:1788664488.224326:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788664488.224336:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222261760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224405:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222261760:12345-0@lo:400:kworker.0 Request processed in 70us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.224411:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788664488.224427:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664488.224432:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222261888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224465:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222261888:12345-0@lo:400:kworker.0 Request processed in 33us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.224471:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664488.224492:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664488.224498:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222261632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224523:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222261632:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.224528:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664488.224543:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222261248 00000100:00100000:1.0:1788664488.224546:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222261248 00000100:00100000:1.0:1788664488.224565:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788664488.224570:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224591:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222261248:12345-0@lo:400:kworker.0 Request processed in 22us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.224597:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788664488.224625:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222261376 00000100:00100000:1.0:1788664488.224628:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222261376 00000100:00100000:1.0:1788664488.224647:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222261504 00000100:00100000:1.0:1788664488.224650:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222261504 00000100:00100000:1.0:1788664488.224658:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664488.224663:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222261376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.224686:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222261376:12345-0@lo:400:kworker.0 Request processed in 23us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.224691:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788664488.224700:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664488.224704:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3306:x1875550222261504:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788664488.224735:0:15066:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:1.0:1788664488.224774:0:15066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x762f55027be91451 00002000:00100000:1.0:1788664488.224788:0:15066:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b68f85d9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a04 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788664488.224792:0:15066:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788664488.224795:0:15066:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788664488.225116:0:15066:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788664488.225140:0:15066:0:(import.c:65:import_set_state_nolock()) ffff9b68f85de800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664488.225183:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875550222261504:12345-0@lo:8:kworker.0 Request processed in 477us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.225190:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788664488.225215:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664488.225219:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788664488.225473:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b67c722ce00 x1875550222261504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788664513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788664488.225489:0:3306:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788664488.225497:0:3306:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788664488.225501:0:3306:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788664488.225504:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9b68f8d65000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788664488.225516:0:3306:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788664488.225520:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3306:1875550222261504:0@lo:8:kworker.0 00000004:00080000:1.0:1788664488.225562:0:14405:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788664488.225576:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1467b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14405:1875550222262144:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788664488.225602:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.225616:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58eb000 going to sleep for 11 seconds 00000004:00080000:1.0:1788664488.225631:0:14404:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788664488.225952:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788664488.225967:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222262016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664488.225994:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664488.226023:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262016 00000100:00100000:1.0:1788664488.226028:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262016 00000100:00100000:1.0:1788664488.226063:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664488.226070:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222262016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664488.226095:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664488.226128:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875550222262016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.226135:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788664488.226152:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788664488.226170:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68d1466a00 x1875550222262016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788664504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664488.226184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222262016:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788664488.226211:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68d1464380 x1875550222261632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664488.226220:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222261632:0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.226231:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222261376:0@lo:400:kworker.0 00000100:00100000:1.0:1788664488.226460:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222261248:0@lo:400:kworker.0 00010000:00080000:1.0:1788664488.226472:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68d1466d80 x1875550222261888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664488.226482:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222261888:0@lo:400:kworker.0 00010000:00080000:1.0:1788664488.226492:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68d1465500 x1875550222261760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664488.226511:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222261760:0@lo:400:kworker.0 00000004:00080000:1.0:1788664488.227751:0:14404:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 522211407639ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788664488.227780:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262144 00000100:00100000:1.0:1788664488.227786:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262144 00000100:00100000:1.0:1788664488.229929:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788664488.229946:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14405:x1875550222262144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788664488.237049:0:15067:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788664488.237060:0:15067:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788664488.237066:0:15067:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1788664488.255106:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.255119:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.255137:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.255142:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.255149:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.255167:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.255178:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.255186:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.255220:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.255362:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.255369:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.255388:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2e00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.255393:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.255402:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.255418:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.255426:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5251ab3/0x762f55027be91458 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.255448:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.255450:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.255452:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.256681:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.256691:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.256704:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.256708:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.256713:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.256741:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.256750:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.256758:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.256770:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664488.257557:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.257565:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.257576:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.257585:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.257590:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.257600:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.257609:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.257616:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.257634:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788664488.257911:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664488.257919:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.257928:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664488.257933:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.257942:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.257961:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.257970:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad81d1a/0x762f55027be9145f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.257989:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664488.257992:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.257998:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2c00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664488.258001:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258015:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258025:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258032:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be91466 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258043:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664488.258045:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664488.258046:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.258593:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.258600:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.258611:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.258614:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.258619:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.258630:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.258637:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.258649:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.258660:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664488.258892:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664488.258899:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258906:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664488.258909:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258916:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258928:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258945:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c048c99/0x762f55027be9146d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.258962:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664488.258963:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664488.258965:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.259487:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.259499:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.259505:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259514:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.259517:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.259521:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259529:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259538:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259544:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259557:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788664488.259565:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788664488.259568:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259583:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664488.259587:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259595:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259606:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259613:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91474 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.259624:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.259626:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.259627:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788664488.260567:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788664488.260671:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.260678:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.260691:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.260694:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.260699:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.260710:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.260742:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.260748:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.260767:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.260800:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.260806:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.260814:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.260818:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.260838:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.260852:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.260860:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe7d4578/0x762f55027be9147b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.260877:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.260879:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.260881:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.261393:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.261400:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.261410:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.261413:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.261418:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.261427:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.261435:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.261442:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.261579:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788664488.261882:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788664488.261888:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.261897:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664488.261901:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.261910:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.261922:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.261929:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91482 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.261943:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664488.261945:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664488.261946:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.262556:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.262562:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.262572:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.262576:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.262581:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.262591:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.262599:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.262606:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.262626:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.262799:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.262806:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.262813:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3a00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.262816:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.262823:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.262834:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.262852:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba983761/0x762f55027be91489 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.262867:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.262869:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.262870:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.263697:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.263704:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.263831:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.263841:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.263847:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.263859:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.263868:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.263934:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.263985:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664488.264549:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.264555:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.264565:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.264568:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.264573:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.264582:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.264590:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.264603:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.267046:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788664488.267059:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.267073:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664488.267079:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.267091:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.267111:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664488.267119:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000550928d7/0x762f55027be91490 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.267261:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.267267:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.267275:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.267278:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.267286:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.267296:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.267305:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.267307:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.267360:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788664488.267367:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be91497 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664488.268170:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.268178:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.268190:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.268195:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.268202:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.268214:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.268223:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.268231:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.269047:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664488.269057:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.269068:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.269073:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.269082:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.269101:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.269110:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.269112:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.269114:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.270213:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.271170:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788664488.271182:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000120a8535/0x762f55027be9149e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664488.272539:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.272549:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.272564:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.272568:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.272574:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.272587:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.272596:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.272604:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.272649:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664488.272656:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.272664:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.272669:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.272679:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.272693:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.272702:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.272704:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.272705:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.273146:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788664488.273153:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f574deb/0x762f55027be914a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664488.273689:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.273697:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.273708:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.273726:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.273732:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.273744:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.273752:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.273759:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.274535:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664488.274545:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.274555:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6c00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.274561:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.274570:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.274598:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.274608:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.274610:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.274612:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.274664:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788664488.274670:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab21928e/0x762f55027be914ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.274938:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.276111:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.276120:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.276146:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.276150:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.276155:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.276168:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.276177:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.276186:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.276201:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664488.276369:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664488.276376:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.276385:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7e00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.276390:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.276399:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.276413:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.276421:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051644789/0x762f55027be914b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.276438:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.276439:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.276446:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.277104:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.277112:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277122:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.277125:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.277130:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277140:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277159:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277166:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277224:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664488.277733:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.277739:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277749:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.277752:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.277757:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277766:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277775:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.277983:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278216:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664488.278224:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278233:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7c00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.278238:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278247:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278274:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278283:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3429580/0x762f55027be914ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278305:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664488.278308:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278315:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.278319:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278326:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278477:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.278487:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.278489:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664488.278492:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.278641:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788664488.278645:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce84e7a/0x762f55027be914c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664488.279406:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.279413:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.279425:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.279429:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.279434:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.279446:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.279454:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.279565:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.290539:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664488.290553:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.290564:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6e00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.290568:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.290577:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.290595:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.290636:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.290638:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.290641:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.290678:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788664488.290687:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086f9aeca/0x762f55027be914c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.291963:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.293568:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.293579:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.293592:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.293596:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.293601:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.293611:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.293618:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.293623:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.293638:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.293662:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.293669:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.293677:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.293682:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.293690:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.293723:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.293731:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000790092b0/0x762f55027be914cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.293753:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.293754:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.293756:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.295182:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.295189:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.295200:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.295203:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.295212:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.295221:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.296753:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.296818:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.296919:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664488.297445:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.297459:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.297468:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.297471:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.297475:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.297484:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.297489:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.297502:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.306786:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664488.306802:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.306817:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664488.306829:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.306842:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.306996:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664488.307006:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138afd72/0x762f55027be914d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.307191:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.307197:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.307205:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.307208:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.307227:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.307238:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.307247:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.307249:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.307251:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.308543:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788664488.308550:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.308555:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c33f01/0x762f55027be914dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664488.311062:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.311074:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.311090:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.311095:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.311102:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.311116:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.311125:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.311133:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.311162:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788664488.312668:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.312678:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.312691:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788664488.312927:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.312936:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.312945:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7a00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.312950:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.312961:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.312980:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.312987:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1a4c911/0x762f55027be914e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.313034:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.313036:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.313038:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.313303:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.313311:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.313323:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.313332:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.313391:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.313415:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.313448:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.313453:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.313462:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.313465:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.313473:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.313485:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.313492:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a3f4690/0x762f55027be914eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.313510:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.313512:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.313513:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.316310:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.316326:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.316369:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.316383:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.316390:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.316405:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.316415:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.316423:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.316548:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.317842:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.317852:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.317877:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.317882:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.317893:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.317911:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.317920:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d690702f/0x762f55027be914f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788664488.317945:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788664488.317947:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.317948:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.317950:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664488.317952:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.317961:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.317965:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.317971:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.317983:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.317992:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.318005:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.318025:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.319089:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.319099:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.319176:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a7800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.319181:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.319192:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.319219:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.319227:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3b60bd4/0x762f55027be914f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.319251:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.319253:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.319254:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.320076:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.320085:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.320098:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.320102:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.320108:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.320120:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.320128:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.320134:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.320158:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.320186:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.320192:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.320200:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6600 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.320204:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.320213:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.320226:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.320233:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6dadb6d/0x762f55027be91500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.320262:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.320264:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.320266:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.322003:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.322014:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.322034:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.322038:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.322044:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.322057:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.322067:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.322074:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.322097:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.322182:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.322188:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.322197:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.322201:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.322211:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.322225:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.322233:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adf556af/0x762f55027be91507 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.322254:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.322256:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.322258:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.324356:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.324370:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.324385:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.324389:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.324394:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.324408:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.324430:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.324437:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.324455:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.324599:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.324607:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.324626:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c75a6a00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.324631:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.324641:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.324657:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.324665:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0f6c4df/0x762f55027be9150e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.324704:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.324706:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.324707:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788664488.326520:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788664488.326532:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.326547:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=522s v=(0 0) 00010000:00010000:1.0:1788664488.326552:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664488.326557:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.326570:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.326579:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.326587:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664488.326620:0:15067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788664488.326779:0:14370:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788664488.326787:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.326795:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f2400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664488.326800:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.326809:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.326833:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.326841:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000204065f6/0x762f55027be91515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664488.326863:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.326866:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664488.326868:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788664488.327551:0:15067:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788664488.327652:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14405:x1875550222262144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 97708us (102046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664488.327662:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788664488.327804:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1467b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14405:1875550222262144:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788664488.327821:0:14405:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788664488.327868:0:14405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14405:1875550222262272:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788664488.327904:0:14405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664488.327948:0:14405:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c92aac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788664488.327995:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262272 00000100:00100000:3.0:1788664488.328013:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262272 00000100:00100000:3.0:1788664488.328053:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788664488.328061:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14405:x1875550222262272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788664488.328098:0:15064:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788664488.342197:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14405:x1875550222262272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14127us (14283us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788664488.342211:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664488.342250:0:14405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14405:1875550222262272:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788664488.342267:0:14405:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788664488.735463:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664489.760478:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788664490.626610:0:16141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788664490.785585:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664491.809904:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664491.813023:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222262400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664491.814504:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664491.814847:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262400 00000100:00100000:0.0:1788664491.814857:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262400 00000100:00080000:1.0:1788664491.815499:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664491.815933:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664491.815946:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222262400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664491.815985:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664491.816056:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222262400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664491.816063:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788664491.819600:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222262400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664492.838805:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788664493.089257:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788664493.277715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.278258:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438016 00000100:00100000:1.0:1788664493.278269:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438016 00000100:00100000:1.0:1788664493.278315:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:1.0:1788664493.278324:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875550204438016:12345-192.168.202.14@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788664493.279150:0:14373:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6e3ae5a8-6e10-40f2-ad30-a70c29eb325f@192.168.202.14@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1788664493.279180:0:14373:0:(genops.c:1385:class_connect()) connect: client 6e3ae5a8-6e10-40f2-ad30-a70c29eb325f, cookie 0x762f55027be9151c 00000100:00080000:1.0:1788664493.279306:0:14373:0:(import.c:65:import_set_state_nolock()) ffff9b68f85db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664493.281175:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+5:2357:x1875550204438016:12345-192.168.202.14@tcp:250:mount.lustre.0 Request processed in 2841us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.281191:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 76 00000100:00100000:1.0:1788664493.292144:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664493.296096:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438144 00000100:00100000:3.0:1788664493.296115:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438144 00000100:00100000:3.0:1788664493.296176:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:3.0:1788664493.296187:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+5:13765:x1875550204438144:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788664493.296206:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664493.296236:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3000/0x762f55027be91523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243af4 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664493.296269:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3000/0x762f55027be91523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243af4 expref: 6 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664493.296282:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b3000/0x762f55027be91523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243af4 expref: 6 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664493.296292:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b3000, rc 0) 00000100:00100000:3.0:1788664493.297668:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+6:13765:x1875550204438144:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 1474us (5527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.297680:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 77 00000100:00100000:0.0:1788664493.305182:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.305302:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438272 00000100:00100000:1.0:1788664493.305314:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438272 00000100:00100000:1.0:1788664493.305398:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:1.0:1788664493.305423:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+6:13765:x1875550204438272:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788664493.305798:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+6:13765:x1875550204438272:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 375us (628us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788664493.305806:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 78 00000100:00100000:1.0:1788664493.309907:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664493.309979:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438400 00000100:00100000:0.0:1788664493.309990:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438400 00000100:00100000:0.0:1788664493.310044:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:0.0:1788664493.310056:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+6:13765:x1875550204438400:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788664493.310074:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664493.310092:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68e66ee000/0x762f55027be9152a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243afb expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664493.310120:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68e66ee000/0x762f55027be9152a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243afb expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664493.310132:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68e66ee000/0x762f55027be9152a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243afb expref: 7 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664493.310142:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ee000, rc 0) 00000100:00100000:0.0:1788664493.310199:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+7:13765:x1875550204438400:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 146us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664493.310207:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 79 00000100:00100000:1.0:1788664493.331826:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664493.331974:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438528 00000100:00100000:3.0:1788664493.331985:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438528 00000100:00100000:3.0:1788664493.332219:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:3.0:1788664493.332230:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+7:13765:x1875550204438528:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788664493.333195:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13765:x1875550204438528:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 962us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.333206:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 80 00000100:00100000:0.0:1788664493.339442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.339829:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438656 00000100:00100000:1.0:1788664493.339842:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438656 00000100:00100000:1.0:1788664493.339898:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:1.0:1788664493.339910:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13765:x1875550204438656:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788664493.340309:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13765:x1875550204438656:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 400us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.340318:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 81 00000100:00100000:0.0:1788664493.344792:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222262912:0@lo:400:kworker.0 00000100:00100000:0.0:1788664493.344874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664493.344959:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664493.344968:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222262784:0@lo:400:kworker.0 00000100:00100000:0.0:1788664493.345004:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664493.345060:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222262528:0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345100:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664493.345128:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222263040:0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345151:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664493.345170:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788664493.345176:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222262656:0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345198:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664493.345213:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222263168:0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345232:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664493.345263:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262912 00000100:00100000:1.0:1788664493.345270:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262912 00000100:00100000:1.0:1788664493.345311:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263040 00000100:00100000:1.0:1788664493.345321:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263040 00000100:00100000:1.0:1788664493.345369:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263168 00000100:00100000:1.0:1788664493.345372:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263168 00000100:00100000:1.0:1788664493.345386:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664493.345393:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222262912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345445:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222262912:12345-0@lo:400:kworker.0 Request processed in 51us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.345451:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788664493.345471:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664493.345476:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222263040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345507:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222263040:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.345513:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788664493.345524:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664493.345531:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222263168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345569:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222263168:12345-0@lo:400:kworker.0 Request processed in 38us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.345574:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788664493.345592:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262784 00000100:00100000:1.0:1788664493.345595:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262784 00000100:00100000:1.0:1788664493.345617:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262656 00000100:00100000:1.0:1788664493.345619:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262656 00000100:00100000:1.0:1788664493.345631:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664493.345636:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875550222262784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345665:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875550222262784:12345-0@lo:400:kworker.0 Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.345672:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788664493.345691:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664493.345697:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222262656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345727:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222262656:12345-0@lo:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.345732:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788664493.345754:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664493.345758:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788664493.345761:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664493.345807:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222262656:0@lo:400:kworker.0 00010000:00080000:1.0:1788664493.345820:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68e7ed9f80 x1875550222263168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664493.345829:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222263168:0@lo:400:kworker.0 00010000:00080000:1.0:1788664493.345837:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68e7ed9880 x1875550222263040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788664493.345844:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222263040:0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345872:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222262528 00000100:00100000:1.0:1788664493.345875:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222262528 00000100:00100000:1.0:1788664493.345899:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664493.345907:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222262528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.345961:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222262528:12345-0@lo:400:kworker.0 Request processed in 56us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.345969:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788664493.346005:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222262528:0@lo:400:kworker.0 00000100:00100000:2.0:1788664493.346800:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222263296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664493.346840:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664493.346885:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263296 00000100:00100000:2.0:1788664493.346889:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263296 00000100:00100000:2.0:1788664493.346922:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664493.346929:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222263296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788664493.346958:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664493.347009:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875550222263296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664493.347015:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664493.347054:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222263296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788664493.347880:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222262784:0@lo:400:kworker.0 00010000:00080000:0.0:1788664493.347898:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b68e7ed8a80 x1875550222262912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788664509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788664493.347908:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222262912:0@lo:400:kworker.0 00000100:00100000:1.0:1788664493.351870:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.351926:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438784 00000100:00100000:1.0:1788664493.352621:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438784 00000100:00100000:1.0:1788664493.352860:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:1.0:1788664493.352870:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13783:x1875550204438784:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664493.365521:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1a7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13783:x1875550204438784:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 12641us (13653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.365550:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 83 00000100:00100000:0.0:1788664493.397209:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.397444:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204438912 00000100:00100000:1.0:1788664493.397454:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204438912 00000100:00100000:1.0:1788664493.397502:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:1.0:1788664493.397511:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13783:x1875550204438912:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664493.398902:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13783:x1875550204438912:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 1383us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.398916:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 84 00000100:00100000:2.0:1788664493.410953:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664493.411080:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439040 00000100:00100000:3.0:1788664493.411092:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439040 00000100:00100000:3.0:1788664493.411157:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:3.0:1788664493.411167:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+8:13765:x1875550204439040:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788664493.411230:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664493.411251:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3a00/0x762f55027be91531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243b25 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664493.411294:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3a00/0x762f55027be91531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b25 expref: 9 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664493.411306:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b3a00/0x762f55027be91531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b25 expref: 9 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664493.411315:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b3a00, rc 0) 00000100:00100000:3.0:1788664493.411387:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+9:13765:x1875550204439040:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 221us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.411395:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 85 00000100:00100000:1.0:1788664493.425506:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664493.428419:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439168 00000100:00100000:3.0:1788664493.428437:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439168 00000100:00100000:3.0:1788664493.428518:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:3.0:1788664493.428530:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+9:13765:x1875550204439168:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788664493.428559:0:14375:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788664493.428585:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788664493.428589:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788664493.428592:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788664493.428595:0:14375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788664493.439779:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+9:13765:x1875550204439168:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 11239us (14270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.439795:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 86 00000100:00100000:3.0:1788664493.443734:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664493.443828:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439296 00000100:00100000:2.0:1788664493.443848:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439296 00000100:00100000:2.0:1788664493.443902:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:2.0:1788664493.443913:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+9:13765:x1875550204439296:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788664493.443930:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664493.443948:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243b2c expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664493.443976:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 10 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664493.443989:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 10 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664493.443999:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b600, rc 0) 00000100:00100000:2.0:1788664493.444051:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13765:x1875550204439296:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 140us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664493.444058:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 87 00000100:00100000:2.0:1788664493.446788:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664493.446941:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439424 00000100:00100000:3.0:1788664493.446951:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439424 00000100:00100000:3.0:1788664493.447001:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788664493.447011:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13765:x1875550204439424:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788664493.447259:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13765:x1875550204439424:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 248us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.447276:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 88 00000100:00100000:3.0:1788664493.451042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664493.451118:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439552 00000100:00100000:0.0:1788664493.451128:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439552 00000100:00100000:0.0:1788664493.451189:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:0.0:1788664493.451199:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13765:x1875550204439552:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788664493.451541:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13765:x1875550204439552:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 343us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664493.451549:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 89 00000100:00100000:3.0:1788664493.456129:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664493.456173:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439680 00000100:00100000:3.0:1788664493.456183:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439680 00000100:00100000:3.0:1788664493.456234:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:3.0:1788664493.456244:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13788:x1875550204439680:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664493.459939:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13788:x1875550204439680:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 3684us (3809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.459955:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 90 00000100:00100000:3.0:1788664493.465418:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.466669:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439808 00000100:00100000:1.0:1788664493.466681:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439808 00000100:00100000:1.0:1788664493.466740:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:1.0:1788664493.466751:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13788:x1875550204439808:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664493.467091:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13788:x1875550204439808:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 341us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.467100:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 91 00000100:00100000:3.0:1788664493.470627:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664493.471091:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204439936 00000100:00100000:0.0:1788664493.471101:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204439936 00000100:00100000:0.0:1788664493.471148:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788664493.471157:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875550204439936:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788664493.471191:0:14382:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 858d447e-f0c4-466d-ab69-4a91760bbec5@192.168.202.14@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:0.0:1788664493.471235:0:14382:0:(genops.c:1385:class_connect()) connect: client 858d447e-f0c4-466d-ab69-4a91760bbec5, cookie 0x762f55027be9153f 00000004:00100000:0.0:1788664493.471264:0:14382:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b6 00000001:00000004:0.0:1788664493.471270:0:14382:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00100000:1.0:1788664493.502264:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788664493.502299:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00080000:1.0:1788664493.539534:0:14382:0:(import.c:65:import_set_state_nolock()) ffff9b68f85df800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664493.539624:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2357:x1875550204439936:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 68466us (69004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.539635:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:1.0:1788664493.544811:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.544917:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664493.554202:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440192 00000100:00100000:2.0:1788664493.554217:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440192 00000100:00100000:3.0:1788664493.554882:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440064 00000100:00100000:3.0:1788664493.554953:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440064 00000100:00080000:1.0:1788664493.555082:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664493.556952:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788664493.556976:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+7:0:x1875550204440064:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788664493.557026:0:15795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788664493.557139:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+7:0:x1875550204440064:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 174us (12221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.557147:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:3.0:1788664493.558685:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:3.0:1788664493.558697:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13765:x1875550204440192:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788664493.558726:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788664493.558807:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1466680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13765:x1875550204440192:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 111us (14004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.558828:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788664493.561552:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.561657:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440320 00000100:00100000:1.0:1788664493.561667:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440320 00000100:00100000:1.0:1788664493.561777:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:1.0:1788664493.561788:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13765:x1875550204440320:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788664493.561876:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13765:x1875550204440320:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.561885:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788664493.568559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.568703:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440448 00000100:00100000:1.0:1788664493.568713:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440448 00000100:00100000:1.0:1788664493.569006:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:1.0:1788664493.569014:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875550204440448:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788664493.569048:0:15067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 858d447e-f0c4-466d-ab69-4a91760bbec5@192.168.202.14@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:1.0:1788664493.569088:0:15067:0:(genops.c:1385:class_connect()) connect: client 858d447e-f0c4-466d-ab69-4a91760bbec5, cookie 0x762f55027be91546 00002000:00100000:1.0:1788664493.569099:0:15067:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 858d447e-f0c4-466d-ab69-4a91760bbec5/ffff9b68c2d8b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788664493.569123:0:15067:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b6 00002000:00080000:1.0:1788664493.569534:0:15067:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788664493.569567:0:15067:0:(import.c:65:import_set_state_nolock()) ffff9b68c2d8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664493.569643:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2357:x1875550204440448:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 627us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.569661:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788664493.572073:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664493.572185:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440576 00000100:00100000:3.0:1788664493.572197:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440576 00000100:00100000:3.0:1788664493.572240:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788664493.572250:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875550204440576:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788664493.572284:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 858d447e-f0c4-466d-ab69-4a91760bbec5@192.168.202.14@tcp t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1788664493.572319:0:15064:0:(genops.c:1385:class_connect()) connect: client 858d447e-f0c4-466d-ab69-4a91760bbec5, cookie 0x762f55027be9154d 00002000:00100000:3.0:1788664493.572331:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 858d447e-f0c4-466d-ab69-4a91760bbec5/ffff9b67c5b56800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788664493.572386:0:15064:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b6 00002000:00080000:3.0:1788664493.572747:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788664493.572777:0:15064:0:(import.c:65:import_set_state_nolock()) ffff9b67c5b54000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664493.572844:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2357:x1875550204440576:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 595us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664493.572853:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:3.0:1788664493.574824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664493.574928:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440704 00000100:00100000:2.0:1788664493.574937:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440704 00000100:00100000:2.0:1788664493.575024:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:2.0:1788664493.575034:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13765:x1875550204440704:12345-192.168.202.14@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788664493.579827:0:14383:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4732us 00000004:00200000:2.0:1788664493.599564:0:14383:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788664493.599698:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13765:x1875550204440704:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 24649us (24865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664493.599710:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00010000:00010000:3.0:1788664493.855932:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664493.881411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664493.881643:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440832 00000100:00100000:1.0:1788664493.881653:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440832 00000100:00100000:1.0:1788664493.881715:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:1.0:1788664493.881727:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13809:x1875550204440832:12345-192.168.202.14@tcp:101:mkdir.0 00010000:00010000:1.0:1788664493.881750:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664493.881831:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2e00/0x762f55027be91554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243b56 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664493.881907:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3600/0x762f55027be9155b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664493.881923:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3600/0x762f55027be9155b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664493.881937:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3600/0x762f55027be9155b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664493.881973:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788664493.881977:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664493.882042:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3600/0x762f55027be9155b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664493.882068:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2e00/0x762f55027be91554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b56 expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664493.882089:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3600/0x762f55027be9155b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b56 expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664493.882121:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:1.0:1788664493.882124:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664493.882127:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f3600, rc 0) 00000100:00100000:1.0:1788664493.882197:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+7:13809:x1875550204440832:12345-192.168.202.14@tcp:101:mkdir.0 Request processed in 471us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664493.882213:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00010000:00010000:2.0:1788664494.879591:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664495.892176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664495.892506:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204440960 00000100:00100000:3.0:1788664495.892517:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204440960 00000100:00100000:3.0:1788664495.892592:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:3.0:1788664495.892617:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+7:13861:x1875550204440960:12345-192.168.202.14@tcp:41:lfs.0 00000100:00080000:1.0:1788664495.892721:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788664495.893089:0:15795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788664495.893188:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+7:13861:x1875550204440960:12345-192.168.202.14@tcp:41:lfs.0 Request processed in 585us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664495.893212:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788664495.899524:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664495.899644:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441088 00000100:00100000:0.0:1788664495.899655:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441088 00000100:00100000:0.0:1788664495.899732:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788664495.899743:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13861:x1875550204441088:12345-192.168.202.14@tcp:13:lfs.0 00002000:00000024:0.0:1788664495.899786:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664495.899889:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13861:x1875550204441088:12345-192.168.202.14@tcp:13:lfs.0 Request processed in 148us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664495.899897:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00080000:1.0:1788664495.899968:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788664495.904746:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664495.907470:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664495.911557:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441216 00000100:00100000:0.0:1788664495.911574:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441216 00000100:00100000:0.0:1788664495.911689:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788664495.911701:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13861:x1875550204441216:12345-192.168.202.14@tcp:13:lfs.0 00002000:00000024:0.0:1788664495.911744:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664495.911832:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:858d447e-f0c4-466d-ab69-4a91760bbec5+6:13861:x1875550204441216:12345-192.168.202.14@tcp:13:lfs.0 Request processed in 134us (4372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664495.911839:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00080000:1.0:1788664495.911969:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664496.163457:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664496.163736:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441344 00000100:00100000:1.0:1788664496.163746:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441344 00000100:00100000:1.0:1788664496.163816:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:1.0:1788664496.163827:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+10:13892:x1875550204441344:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788664496.163846:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664496.163864:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b67c10f2e00/0x762f55027be91562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243b5d expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.163905:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b67c10f2e00/0x762f55027be91562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b5d expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.163917:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b67c10f2e00/0x762f55027be91562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b5d expref: 11 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.163925:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f2e00, rc 0) 00000100:00100000:1.0:1788664496.163989:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13892:x1875550204441344:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 163us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664496.164014:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 92 00000100:00100000:2.0:1788664496.170393:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.170521:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441472 00000100:00100000:3.0:1788664496.170531:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441472 00000100:00100000:3.0:1788664496.170589:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:3.0:1788664496.170598:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13892:x1875550204441472:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788664496.170964:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13892:x1875550204441472:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 366us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664496.170973:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 93 00000100:00100000:2.0:1788664496.178913:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.180372:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441600 00000100:00100000:3.0:1788664496.180385:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441600 00000100:00100000:3.0:1788664496.180449:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:3.0:1788664496.180459:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13892:x1875550204441600:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788664496.187543:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13892:x1875550204441600:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 7071us (8627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664496.187558:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 94 00000100:00100000:2.0:1788664496.205524:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664496.205693:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441728 00000100:00100000:1.0:1788664496.205704:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441728 00000100:00100000:1.0:1788664496.206054:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:1.0:1788664496.206066:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13900:x1875550204441728:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788664496.206525:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13900:x1875550204441728:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 460us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664496.206534:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 95 00000100:00100000:0.0:1788664496.234577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.234682:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441856 00000100:00100000:3.0:1788664496.234693:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441856 00000100:00100000:3.0:1788664496.234760:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:3.0:1788664496.234771:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d099b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13900:x1875550204441856:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788664496.235076:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d099b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13900:x1875550204441856:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 306us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664496.235085:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 96 00000100:00100000:2.0:1788664496.240066:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664496.240294:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204441984 00000100:00100000:1.0:1788664496.240314:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204441984 00000100:00100000:1.0:1788664496.240390:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:1.0:1788664496.240401:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13892:x1875550204441984:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788664496.241484:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664496.241510:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b67c10f3c00/0x762f55027be91569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243b87 expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.241542:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b67c10f3c00/0x762f55027be91569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b87 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.241550:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b67c10f3c00/0x762f55027be91569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b87 expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.241557:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f3c00, rc 0) 00000100:00100000:1.0:1788664496.241612:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13892:x1875550204441984:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 1213us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664496.241620:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 97 00000100:00100000:0.0:1788664496.244003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664496.244329:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204442112 00000100:00100000:2.0:1788664496.244378:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204442112 00000100:00100000:2.0:1788664496.244436:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:2.0:1788664496.244447:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13892:x1875550204442112:12345-192.168.202.14@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788664496.244485:0:14375:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788664496.244511:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788664496.244516:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788664496.244519:0:14375:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788664496.244522:0:14375:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788664496.246063:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13892:x1875550204442112:12345-192.168.202.14@tcp:256:mount.lustre.0 Request processed in 1612us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664496.246072:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 98 00000100:00100000:3.0:1788664496.248465:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664496.249177:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204442240 00000100:00100000:1.0:1788664496.249200:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204442240 00000100:00100000:1.0:1788664496.249264:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:1.0:1788664496.249274:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13892:x1875550204442240:12345-192.168.202.14@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788664496.249292:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664496.249320:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243b8e expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.249377:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.249389:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 13 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664496.249399:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f3e00, rc 0) 00000100:00100000:1.0:1788664496.249467:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13892:x1875550204442240:12345-192.168.202.14@tcp:101:mount.lustre.0 Request processed in 194us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664496.249482:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 99 00000100:00100000:0.0:1788664496.251487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664496.251677:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204442368 00000100:00100000:2.0:1788664496.251684:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204442368 00000100:00100000:2.0:1788664496.251725:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:2.0:1788664496.251734:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13892:x1875550204442368:12345-192.168.202.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788664496.252004:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13892:x1875550204442368:12345-192.168.202.14@tcp:501:mount.lustre.0 Request processed in 270us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664496.252012:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 100 00000100:00100000:0.0:1788664496.254115:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.254227:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204442496 00000100:00100000:3.0:1788664496.254236:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204442496 00000100:00100000:3.0:1788664496.254287:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:3.0:1788664496.254305:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13892:x1875550204442496:12345-192.168.202.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788664496.254960:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13892:x1875550204442496:12345-192.168.202.14@tcp:503:mount.lustre.0 Request processed in 661us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664496.254970:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 101 00000100:00100000:3.0:1788664496.259172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664496.260089:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204442624 00000100:00100000:2.0:1788664496.260101:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204442624 00000100:00100000:2.0:1788664496.260211:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:2.0:1788664496.260221:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13906:x1875550204442624:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664496.260518:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13906:x1875550204442624:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 298us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664496.260528:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 102 00000100:00100000:0.0:1788664496.266441:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664496.266700:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204442752 00000100:00100000:2.0:1788664496.266720:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204442752 00000100:00100000:2.0:1788664496.266830:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:2.0:1788664496.266841:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13906:x1875550204442752:12345-192.168.202.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788664496.267109:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13906:x1875550204442752:12345-192.168.202.14@tcp:502:llog_process_th.0 Request processed in 269us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664496.267136:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 103 00000100:00100000:0.0:1788664496.281174:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664496.281272:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204442880 00000100:00100000:1.0:1788664496.281294:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204442880 00000100:00100000:1.0:1788664496.281376:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788664496.281384:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875550204442880:12345-192.168.202.14@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788664496.281437:0:14382:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6b12abac-893f-40cc-90ed-06a46322c2d8@192.168.202.14@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1788664496.281497:0:14382:0:(genops.c:1385:class_connect()) connect: client 6b12abac-893f-40cc-90ed-06a46322c2d8, cookie 0x762f55027be91577 00000004:00100000:1.0:1788664496.281528:0:14382:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b6 00000100:00080000:1.0:1788664496.281747:0:14382:0:(import.c:65:import_set_state_nolock()) ffff9b68c2d8e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788664496.281869:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2357:x1875550204442880:12345-192.168.202.14@tcp:38:mount.lustre.0 Request processed in 483us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664496.281902:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788664496.286778:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664496.286825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.287000:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443136 00000100:00100000:3.0:1788664496.287011:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443136 00000100:00100000:3.0:1788664496.287091:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443008 00000100:00100000:3.0:1788664496.287095:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443008 00000100:00100000:3.0:1788664496.287124:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788664496.287134:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+7:13892:x1875550204443136:12345-192.168.202.14@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788664496.287278:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788664496.287300:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+7:0:x1875550204443008:12345-192.168.202.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788664496.288078:0:15795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788664496.288158:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+7:13892:x1875550204443136:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 1024us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664496.288167:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000004:00000024:0.0:1788664496.288713:0:14382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788664496.288761:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+6:0:x1875550204443008:12345-192.168.202.14@tcp:41:mount.lustre.0 Request processed in 1465us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664496.288769:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00080000:1.0:1788664496.289368:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664496.299157:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.299387:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443264 00000100:00100000:3.0:1788664496.299398:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443264 00000100:00100000:3.0:1788664496.299478:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:3.0:1788664496.299498:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+6:13892:x1875550204443264:12345-192.168.202.14@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788664496.299594:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+6:13892:x1875550204443264:12345-192.168.202.14@tcp:40:mount.lustre.0 Request processed in 105us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664496.299602:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:3.0:1788664496.304099:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.304212:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664496.308040:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664496.308965:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443648 00000100:00100000:0.0:1788664496.308977:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443648 00000100:00100000:0.0:1788664496.309033:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:0.0:1788664496.309043:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+6:13892:x1875550204443648:12345-192.168.202.14@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788664496.309114:0:14384:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788664496.309209:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+6:13892:x1875550204443648:12345-192.168.202.14@tcp:33:mount.lustre.0 Request processed in 166us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664496.309217:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788664496.309773:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443392 00000100:00100000:1.0:1788664496.309781:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443392 00000100:00100000:1.0:1788664496.309847:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443520 00000100:00100000:1.0:1788664496.309851:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443520 00000100:00100000:3.0:1788664496.309879:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788664496.309887:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875550204443392:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788664496.309913:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6b12abac-893f-40cc-90ed-06a46322c2d8@192.168.202.14@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1788664496.309959:0:15064:0:(genops.c:1385:class_connect()) connect: client 6b12abac-893f-40cc-90ed-06a46322c2d8, cookie 0x762f55027be9157e 00002000:00100000:3.0:1788664496.309970:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6b12abac-893f-40cc-90ed-06a46322c2d8/ffff9b67c5b51000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788664496.309981:0:15064:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b6 00002000:00080000:3.0:1788664496.310091:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788664496.310120:0:15064:0:(import.c:65:import_set_state_nolock()) ffff9b67c5b52800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664496.310182:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2357:x1875550204443392:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 295us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664496.310191:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:3.0:1788664496.310215:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788664496.310220:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875550204443520:12345-192.168.202.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788664496.310236:0:15064:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6b12abac-893f-40cc-90ed-06a46322c2d8@192.168.202.14@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:3.0:1788664496.310253:0:15064:0:(genops.c:1385:class_connect()) connect: client 6b12abac-893f-40cc-90ed-06a46322c2d8, cookie 0x762f55027be91585 00002000:00100000:3.0:1788664496.310258:0:15064:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6b12abac-893f-40cc-90ed-06a46322c2d8/ffff9b67c5b57800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a04 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788664496.310264:0:15064:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b6 00002000:00080000:3.0:1788664496.310319:0:15064:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788664496.310333:0:15064:0:(import.c:65:import_set_state_nolock()) ffff9b67c5b56000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788664496.310378:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2357:x1875550204443520:12345-192.168.202.14@tcp:8:mount.lustre.0 Request processed in 156us (6166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664496.310384:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:3.0:1788664496.515824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664496.515933:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443776 00000100:00100000:0.0:1788664496.515945:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443776 00000100:00100000:0.0:1788664496.516007:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788664496.516017:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+6:13927:x1875550204443776:12345-192.168.202.14@tcp:101:mkdir.0 00010000:00010000:0.0:1788664496.516038:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664496.516060:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be9158c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bb8 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664496.516123:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664496.516139:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664496.516156:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664496.516224:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788664496.516228:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664496.516250:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664496.516295:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be9158c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664496.516314:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664496.516323:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:0.0:1788664496.516326:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664496.516330:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68e66ef400, rc 0) 00000100:00100000:0.0:1788664496.516456:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+7:13927:x1875550204443776:12345-192.168.202.14@tcp:101:mkdir.0 Request processed in 440us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664496.516464:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00010000:00010000:1.0:1788664496.928828:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664496.928934:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222263424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664496.929029:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664496.929666:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263424 00000100:00100000:1.0:1788664496.929678:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263424 00000100:00100000:1.0:1788664496.929774:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788664496.929785:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222263424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664496.929815:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664496.929897:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222263424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664496.929915:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788664496.930043:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222263424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788664496.930127:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788664497.957554:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788664498.022286:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 858d447e-f0c4-466d-ab69-4a91760bbec5 00000001:00100000:1.0:1788664498.022307:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b12abac-893f-40cc-90ed-06a46322c2d8 00000100:00100000:1.0:1788664498.463785:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222263808:0@lo:400:kworker.0 00000100:00100000:1.0:1788664498.463859:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664498.463922:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664498.463928:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222263936:0@lo:400:kworker.0 00000100:00100000:1.0:1788664498.463951:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664498.464042:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222263552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464078:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664498.464111:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222264064:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464139:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664498.464159:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788664498.464164:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222263680:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464185:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664498.464203:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222264192:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464228:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664498.464256:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263808 00000100:00100000:3.0:1788664498.464263:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263808 00000100:00100000:3.0:1788664498.464312:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263680 00000100:00100000:3.0:1788664498.464315:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263680 00000100:00100000:3.0:1788664498.464334:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664498.464378:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222263808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464432:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222263808:12345-0@lo:400:kworker.0 Request processed in 90us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664498.464440:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788664498.464456:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664498.464462:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222263680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464492:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222263680:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664498.464497:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788664498.464514:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263936 00000100:00100000:3.0:1788664498.464518:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263936 00000100:00100000:3.0:1788664498.464540:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264064 00000100:00100000:3.0:1788664498.464543:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264064 00000100:00100000:3.0:1788664498.464572:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264192 00000100:00100000:3.0:1788664498.464575:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264192 00000100:00100000:3.0:1788664498.464588:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664498.464594:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222263936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464625:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875550222263936:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664498.464630:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664498.464640:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788664498.464646:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222264064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464671:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222264064:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664498.464676:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788664498.464685:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788664498.464691:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222264192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464713:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222264192:12345-0@lo:400:kworker.0 Request processed in 23us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664498.464719:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788664498.464742:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788664498.464746:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788664498.464748:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664498.464783:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1465500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875550222263936:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464794:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788664498.464808:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1465180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222263808:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464837:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222263680:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464845:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222264192:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.464865:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222264064:0@lo:400:kworker.0 00000100:00100000:1.0:1788664498.465304:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222263552 00000100:00100000:1.0:1788664498.465310:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222263552 00000100:00100000:1.0:1788664498.465419:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788664498.465428:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222263552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664498.465479:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222263552:12345-0@lo:400:kworker.0 Request processed in 45us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664498.465493:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788664498.465754:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222263552:0@lo:400:kworker.0 00000100:00100000:3.0:1788664498.469883:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664498.469950:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664498.476219:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264320 00000100:00100000:0.0:1788664498.476236:0:15068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264320 00000100:00100000:0.0:1788664498.476304:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788664498.476316:0:15068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788664498.476386:0:15068:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664498.476480:0:15068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (6519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664498.476488:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788664498.478171:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264320:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788664498.554981:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6b12abac-893f-40cc-90ed-06a46322c2d8 00000001:00100000:1.0:1788664498.555000:0:7657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 858d447e-f0c4-466d-ab69-4a91760bbec5 00010000:00010000:3.0:1788664498.975707:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788664499.001473:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6b12abac-893f-40cc-90ed-06a46322c2d8 00000001:00100000:1.0:1788664499.001490:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 858d447e-f0c4-466d-ab69-4a91760bbec5 00000001:02000400:2.0:1788664499.783865:0:16349:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788664499.999913:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664501.024588:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664501.695713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664501.695767:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664501.695792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664501.695809:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664501.695824:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664501.695841:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664501.695872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664501.695892:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444160 00000100:00100000:0.0:1788664501.695901:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444160 00000100:00100000:0.0:1788664501.695946:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444672 00000100:00100000:0.0:1788664501.695949:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444672 00000100:00100000:0.0:1788664501.695969:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444288 00000100:00100000:0.0:1788664501.695972:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444288 00000100:00100000:0.0:1788664501.695984:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444544 00000100:00100000:0.0:1788664501.695986:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444544 00000100:00100000:0.0:1788664501.695999:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788664501.696008:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204444160:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664501.696079:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204444160:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664501.696087:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788664501.696103:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788664501.696109:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204444672:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664501.696134:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204444672:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664501.696140:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:0.0:1788664501.696151:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:0.0:1788664501.696157:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204444288:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664501.696178:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204444288:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 21us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664501.696190:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:0.0:1788664501.696201:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788664501.696208:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204444544:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664501.696234:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204444544:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664501.696239:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:0.0:1788664501.696256:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444416 00000100:00100000:0.0:1788664501.696259:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444416 00000100:00100000:0.0:1788664501.696284:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444032 00000100:00100000:0.0:1788664501.696286:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444032 00000100:00100000:0.0:1788664501.696304:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788664501.696310:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2358:x1875550204444416:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664501.696336:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2358:x1875550204444416:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664501.696365:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788664501.696376:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:0.0:1788664501.696382:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2358:x1875550204444032:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664501.696402:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2358:x1875550204444032:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 21us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664501.696408:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00080000:0.0:1788664501.696432:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664501.696436:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788664501.696438:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788664501.696774:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204443904 00000100:00100000:1.0:1788664501.696779:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204443904 00000100:00100000:1.0:1788664501.696809:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:1.0:1788664501.696816:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:2358:x1875550204443904:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664501.696841:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:2358:x1875550204443904:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 26us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664501.696847:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 105 00000100:00100000:1.0:1788664502.047718:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664502.047750:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788664502.047844:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664502.047930:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264448 00000100:00100000:1.0:1788664502.047938:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264448 00000100:00100000:1.0:1788664502.047992:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664502.048001:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664502.048038:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664502.048083:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664502.048091:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788664502.048141:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c722fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264448:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788664502.048279:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788664502.048985:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788664503.072736:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788664503.328559:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788664503.583562:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222264576:0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.583644:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664503.583714:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788664503.583721:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222264704:0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.583754:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664503.583793:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264576 00000100:00100000:2.0:1788664503.583802:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264576 00000100:00100000:2.0:1788664503.583850:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664503.583859:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222264576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.583918:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222264576:12345-0@lo:400:kworker.0 Request processed in 59us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.583925:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788664503.583958:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264704 00000100:00100000:2.0:1788664503.583962:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264704 00000100:00100000:2.0:1788664503.584006:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664503.584014:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222264704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.584047:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222264704:12345-0@lo:400:kworker.0 Request processed in 35us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.584053:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664503.584096:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222264704:0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.584105:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222264576:0@lo:400:kworker.0 00000100:00100000:1.0:1788664503.589530:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264832:0@lo:400:kworker.0 00000100:00100000:1.0:1788664503.589605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664503.589643:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222265344:0@lo:400:kworker.0 00000100:00100000:1.0:1788664503.589669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664503.589828:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788664503.589837:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788664503.589866:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664503.589899:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264960 00000100:00100000:1.0:1788664503.589907:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264960 00000100:00100000:1.0:1788664503.589967:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788664503.589975:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264960:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664503.589988:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222265088:0@lo:400:kworker.0 00002000:00000024:1.0:1788664503.590013:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788664503.590029:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664503.590050:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664503.590050:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.590056:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222265216:0@lo:400:kworker.0 00000100:00100000:1.0:1788664503.590058:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788664503.590080:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664503.590104:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222265344 00000100:00100000:1.0:1788664503.590106:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68d1464700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788664503.590107:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222265344 00000100:00100000:2.0:1788664503.590134:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222265088 00000100:00100000:2.0:1788664503.590137:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222265088 00000100:00100000:2.0:1788664503.590150:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222265216 00000100:00100000:2.0:1788664503.590152:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222265216 00000100:00100000:2.0:1788664503.590166:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664503.590171:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222265344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.590216:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875550222265344:12345-0@lo:400:kworker.0 Request processed in 44us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.590223:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788664503.590236:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788664503.590245:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3307:1875550222265344:0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.590254:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222265088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.590293:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875550222265088:12345-0@lo:400:kworker.0 Request processed in 51us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.590300:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788664503.590312:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788664503.590317:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222265216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788664503.590370:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875550222265216:12345-0@lo:400:kworker.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.590377:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788664503.590676:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222264832 00000100:00100000:0.0:1788664503.590688:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222264832 00000100:00100000:0.0:1788664503.590723:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788664503.590731:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664503.590772:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222264832:12345-0@lo:400:kworker.0 Request processed in 43us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664503.590778:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788664503.590798:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788664503.590802:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664503.590886:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222264832:0@lo:400:kworker.0 00000100:00100000:1.0:1788664503.590938:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3309:1875550222265216:0@lo:400:kworker.0 00000100:00100000:1.0:1788664503.590947:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875550222265088:0@lo:400:kworker.0 00000020:00000080:1.0:1788664503.947861:0:16497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc37af4c60 20000000:00000080:1.0:1788664503.947882:0:16497:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b67c72e6c00 uarg=0000000000000000 20000000:01000000:1.0:1788664503.947920:0:16497:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788664503.947926:0:16497:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788664503.947930:0:16497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788664503.952036:0:16498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788664503.952123:0:16497:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788664503.962794:0:16497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788664503.962830:0:16497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962850:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9128a expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962859:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be912d7 expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962867:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be9140b expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962877:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962884:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962892:0:16497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962943:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.962960:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 12 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.962976:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265472:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664503.963424:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 12 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.963445:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 12 pid: 14374 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.963457:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265600:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664503.963617:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9140b expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.963627:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9140b expref: 18 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.963637:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265728:0@lo:104: 00000100:00100000:1.0:1788664503.963679:0:16497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664503.963713:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be912d7 expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.963722:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be912d7 expref: 18 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.963730:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265856:0@lo:104: 00000100:00100000:1.0:1788664503.963752:0:16497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664503.963772:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x762f55027be9128a expref: 18 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.963781:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x762f55027be9128a expref: 18 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.963789:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265984:0@lo:104: 00000100:00100000:1.0:1788664503.963811:0:16497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664503.963831:0:16497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c58ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788664503.964706:0:14364:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788664503.964722:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222265728 00000100:00100000:2.0:1788664503.964736:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222265728 00000100:00100000:2.0:1788664503.964786:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222265856 00000100:00100000:2.0:1788664503.964789:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222265856 00000100:00100000:2.0:1788664503.964798:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222265984 00000100:00100000:2.0:1788664503.964800:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222265984 00000100:00100000:2.0:1788664503.964811:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664503.964832:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+5:16497:x1875550222265728:12345-0@lo:104: 00010000:00010000:2.0:1788664503.964847:0:14364:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.964920:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788664503.964926:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+5:16497:x1875550222265728:12345-0@lo:104: Request processed in 97us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.964934:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788664503.964951:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664503.964957:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+4:16497:x1875550222265856:12345-0@lo:104: 00010000:00010000:2.0:1788664503.964965:0:14364:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965001:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788664503.965006:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+4:16497:x1875550222265856:12345-0@lo:104: Request processed in 50us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.965012:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664503.965023:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788664503.965029:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d0995450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:16497:x1875550222265984:12345-0@lo:104: 00010000:00010000:2.0:1788664503.965038:0:14364:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965066:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788664503.965077:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d0995450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+3:16497:x1875550222265984:12345-0@lo:104: Request processed in 49us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.965083:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788664503.965126:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788664503.965133:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965141:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664503.965145:0:14369:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965154:0:14369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664503.965161:0:14369:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664503.965167:0:14369:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664503.965196:0:14369:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965203:0:14369:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664503.965236:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965243:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68c512a000/0x762f55027be9140b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91412 expref: -99 pid: 15782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965257:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788664503.965260:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965276:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efa00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664503.965279:0:14369:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965286:0:14369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788664503.965292:0:14369:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664503.965297:0:14369:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664503.965313:0:14369:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965328:0:14369:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664503.965371:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965378:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be912d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be912de expref: -99 pid: 15063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965387:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664503.965389:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965394:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b3600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1788664503.965396:0:14369:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.965398:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265728:0@lo:104: 00000100:00100000:1.0:1788664503.965407:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265856:0@lo:104: 00010000:00010000:2.0:1788664503.965413:0:14369:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.965413:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265984:0@lo:104: 10000000:00010000:2.0:1788664503.965420:0:14369:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788664503.965425:0:14369:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788664503.965439:0:14369:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965445:0:14369:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788664503.965451:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965458:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.114@tcp lock: ffff9b68f88b3600/0x762f55027be9128a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x762f55027be91291 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.965470:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664503.965472:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664503.965474:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664503.965486:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222266112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664503.965519:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664503.965569:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222266240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788664503.965592:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664503.965608:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788664503.965613:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222266112 00000100:00100000:2.0:1788664503.965614:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222266368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664503.965618:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222266112 00000100:00100000:2.0:1788664503.965634:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788664503.965636:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9140b expref: 19 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.965650:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222266240 00000100:00100000:1.0:1788664503.965653:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222266240 00000100:00100000:2.0:1788664503.965661:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222266368 00010000:00010000:1.0:1788664503.965664:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be912d7 expref: 20 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664503.965669:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222266368 00000100:00100000:1.0:1788664503.965675:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788664503.965679:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9128a expref: 21 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664503.965681:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+21:3308:x1875550222266112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664503.965691:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788664503.965692:0:14368:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788664503.965695:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9140b expref: 21 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664503.965697:0:14368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788664503.965704:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9140b expref: 21 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.965717:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68e66ee800/0x762f55027be91412 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9140b expref: 21 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.965729:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664503.965758:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+20:3308:x1875550222266112:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664503.965764:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788664503.965788:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788664503.965793:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222266240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664503.965800:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664503.965804:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be912d7 expref: 19 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.965811:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be912d7 expref: 19 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.965821:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68d15f2800/0x762f55027be912de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be912d7 expref: 19 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664503.965831:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3308:1875550222266112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664503.965831:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664503.965856:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:3309:x1875550222266240:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664503.965862:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788664503.965868:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222266240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788664503.965874:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788664503.965880:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c53b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:3309:x1875550222266368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788664503.965887:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664503.965891:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x762f55027be9128a expref: 17 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.965899:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x762f55027be9128a expref: 17 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.965908:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c12ea600/0x762f55027be91291 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x762f55027be9128a expref: 17 pid: 14375 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.965916:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664503.965953:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c53b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:3309:x1875550222266368:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664503.965960:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788664503.965962:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222266368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788664503.966059:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664503.972760:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664503.972802:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664503.972905:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265472:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664503.972917:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875550222265600:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664503.972959:0:16497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664503.973311:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444800 00000100:00100000:2.0:1788664503.973330:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444800 00010000:00010000:2.0:1788664503.973417:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 13 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664503.973448:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204444928 00000100:00100000:2.0:1788664503.973451:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204444928 00010000:00010000:2.0:1788664503.973464:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 14 pid: 14374 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664503.973500:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788664503.973509:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+14:2361:x1875550204444800:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664503.973524:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664503.973529:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 14 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973540:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 14 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973559:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b67c10f3e00/0x762f55027be91570 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b8e expref: 14 pid: 14373 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973588:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664503.973637:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:2361:x1875550204444800:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 129us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.973644:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788664503.973660:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788664503.973666:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:2361:x1875550204444928:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664503.973673:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664503.973678:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 12 pid: 14374 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973687:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 12 pid: 14374 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973697:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b68c512b600/0x762f55027be91538 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b2c expref: 12 pid: 14374 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973708:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973716:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973730:0:14368:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973738:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973754:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973761:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973767:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664503.973771:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973780:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973791:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664503.973800:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664503.973819:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:2361:x1875550204444928:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 153us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664503.973825:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00010000:00010000:1.0:1788664503.974115:0:16497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.974124:0:16497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664503.974130:0:16497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b67c10f3400/0x762f55027be9159a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664504.095995:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664505.120124:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788664505.285001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664505.285210:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445056 00000100:00100000:2.0:1788664505.285230:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445056 00000100:00100000:2.0:1788664505.285306:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:2.0:1788664505.285315:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+11:13779:x1875550204445056:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664505.285336:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664505.285503:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512ac00/0x762f55027be915a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bbf expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664505.285546:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512ac00/0x762f55027be915a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bbf expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664505.285567:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512ac00/0x762f55027be915a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bbf expref: 12 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664505.285578:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512ac00, rc 0) 00000100:00100000:2.0:1788664505.285657:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13779:x1875550204445056:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 343us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664505.285665:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 107 00000100:00100000:3.0:1788664505.303479:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664505.303542:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445184 00000100:00100000:2.0:1788664505.303552:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445184 00000100:00100000:2.0:1788664505.303599:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:2.0:1788664505.303610:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13779:x1875550204445184:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664505.304101:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13779:x1875550204445184:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 492us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664505.304110:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 108 00000100:00100000:2.0:1788664505.313601:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664505.313807:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445312 00000100:00100000:3.0:1788664505.313817:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445312 00000100:00100000:3.0:1788664505.313869:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:3.0:1788664505.313879:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13779:x1875550204445312:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664505.314099:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13779:x1875550204445312:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 221us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664505.314106:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 109 00000100:00100000:0.0:1788664505.349280:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664505.351597:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445440 00000100:00100000:3.0:1788664505.351615:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445440 00000100:00100000:3.0:1788664505.351723:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00100000:3.0:1788664505.351736:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+12:13779:x1875550204445440:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664505.351754:0:14375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664505.351773:0:14375:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3200/0x762f55027be915a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bc6 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.351811:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3200/0x762f55027be915a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bc6 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.351834:0:14375:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b3200/0x762f55027be915a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bc6 expref: 13 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.351844:0:14375:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b3200, rc 0) 00000100:00100000:3.0:1788664505.351931:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13779:x1875550204445440:12345-192.168.202.14@tcp:101:ll_cfg_requeue.0 Request processed in 186us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664505.351939:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 110 00000100:00100000:1.0:1788664505.360943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664505.360992:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445568 00000100:00100000:1.0:1788664505.361002:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445568 00000100:00100000:1.0:1788664505.361048:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 111 00000100:00100000:1.0:1788664505.361057:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13779:x1875550204445568:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664505.361364:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d433dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13779:x1875550204445568:12345-192.168.202.14@tcp:501:ll_cfg_requeue.0 Request processed in 306us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664505.361372:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 111 00000100:00100000:2.0:1788664505.370123:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664505.370249:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445696 00000100:00100000:3.0:1788664505.370259:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445696 00000100:00100000:3.0:1788664505.370331:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 112 00000100:00100000:3.0:1788664505.370379:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13779:x1875550204445696:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664505.370605:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:13779:x1875550204445696:12345-192.168.202.14@tcp:503:ll_cfg_requeue.0 Request processed in 263us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664505.370614:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 112 10000000:01000000:0.0:1788664505.759604:0:14377:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788664505.759613:0:14377:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b67c532e800 from 10 10000000:01000000:0.0:1788664505.759619:0:14377:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664505.759671:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be915af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.759681:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be915af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.759693:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be915af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664505.759718:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.759800:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664505.759851:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f85abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664505.760794:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222266496 00000100:00100000:2.0:1788664505.760804:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222266496 00000100:00100000:2.0:1788664505.760852:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788664505.760860:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+16:14377:x1875550222266496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788664505.760878:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664505.760894:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68c512b000/0x762f55027be915b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be915af expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664505.760918:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68c512b000/0x762f55027be915b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be915af expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664505.760936:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68c512b000/0x762f55027be915b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be915af expref: 17 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664505.760944:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b000, rc 0) 00000100:00100000:2.0:1788664505.760998:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:14377:x1875550222266496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664505.761005:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788664505.761214:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788664505.761232:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be915af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915b6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.761241:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be915af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be915b6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664505.761312:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.761368:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664505.761397:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f85abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664505.761858:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222266624 00000100:00100000:2.0:1788664505.761865:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222266624 00000100:00100000:2.0:1788664505.761899:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788664505.761906:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:14377:x1875550222266624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788664505.762168:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:14377:x1875550222266624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664505.762175:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788664505.764156:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.764231:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.764311:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664505.764367:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f85abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788664505.764906:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222266752 00000100:00100000:2.0:1788664505.764914:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222266752 00000100:00100000:2.0:1788664505.764962:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788664505.764972:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:14377:x1875550222266752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788664505.765185:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:14377:x1875550222266752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664505.765192:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788664505.765920:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788664505.766634:0:16572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788664505.766696:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788664505.766716:0:14377:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664505.766735:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be915af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915b6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.766753:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ef800/0x762f55027be915af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915b6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664505.766764:0:14377:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788664505.766767:0:14377:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68f85c2800 from 10 10000000:01000000:0.0:1788664505.766770:0:14377:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664505.766808:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be915bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.766816:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be915bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.766827:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be915bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664505.766846:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.766894:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664505.770987:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f85abcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664505.771051:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222266880 00000100:00100000:3.0:1788664505.771060:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222266880 00000100:00100000:3.0:1788664505.771117:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788664505.771127:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+17:14377:x1875550222266880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664505.771145:0:14373:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664505.771163:0:14373:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3400/0x762f55027be915c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be915bd expref: -99 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.771192:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3400/0x762f55027be915c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be915bd expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.771216:0:14373:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b3400/0x762f55027be915c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be915bd expref: 18 pid: 14373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.771225:0:14373:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b3400, rc 0) 00000100:00100000:3.0:1788664505.771300:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:14377:x1875550222266880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (4405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664505.771307:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788664505.771588:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222266880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664505.771609:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be915bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915c4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664505.771636:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be915bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be915c4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664505.771713:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664505.772103:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664505.772131:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f250c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788664505.772193:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222267008 00000100:00100000:0.0:1788664505.772199:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222267008 00000100:00100000:0.0:1788664505.772240:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788664505.772258:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:14377:x1875550222267008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.772541:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:14377:x1875550222267008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664505.772548:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788664505.772736:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664505.772779:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664505.772819:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664505.772841:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f250c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664505.772952:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222267136 00000100:00100000:3.0:1788664505.772957:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222267136 00000100:00100000:3.0:1788664505.772989:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788664505.772996:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:14377:x1875550222267136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788664505.773135:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:14377:x1875550222267136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664505.773142:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788664505.775508:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788664505.777451:0:16574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788664505.777730:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788664505.777864:0:14377:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788664505.777878:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be915bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915c4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.777890:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66ee400/0x762f55027be915bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915c4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788664505.777901:0:14377:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788664505.777904:0:14377:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff9b68dff20800 from 10 10000000:01000000:0.0:1788664505.777917:0:14377:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788664505.777954:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be915cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.777962:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be915cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664505.777973:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be915cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664505.778000:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.778071:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664505.778122:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f85abcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664505.778217:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222267264 00000100:00100000:3.0:1788664505.778226:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222267264 00000100:00100000:3.0:1788664505.778286:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788664505.778296:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f9e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+18:14377:x1875550222267264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788664505.778311:0:14374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664505.778326:0:14374:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b68f88b3c00/0x762f55027be915d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x762f55027be915cb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.778392:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b68f88b3c00/0x762f55027be915d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x762f55027be915cb expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.778404:0:14374:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b68f88b3c00/0x762f55027be915d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x762f55027be915cb expref: 19 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664505.778424:0:14374:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b3c00, rc 0) 00000100:00100000:3.0:1788664505.778470:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f9e28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222267264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664505.778477:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788664505.778857:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788664505.778873:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be915cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915d2 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664505.778883:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be915cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x762f55027be915d2 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664505.778936:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664505.778966:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664505.778995:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25000 going to sleep for 11 seconds 00000100:00100000:3.0:1788664505.779166:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222267392 00000100:00100000:3.0:1788664505.779171:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222267392 00000100:00100000:3.0:1788664505.779272:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788664505.779280:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222267392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788664505.779565:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222267392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664505.779572:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788664505.779889:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788664505.779932:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788664505.779973:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664505.779991:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25000 going to sleep for 11 seconds 00000100:00100000:0.0:1788664505.780306:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222267520 00000100:00100000:0.0:1788664505.780312:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222267520 00000100:00100000:0.0:1788664505.780370:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788664505.780378:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222267520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788664505.780548:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:14377:x1875550222267520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664505.780555:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788664505.781846:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:14377:1875550222267520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788664505.785558:0:16575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788664505.786530:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788664505.786563:0:14377:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.202.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788664505.786576:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be915cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915d2 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664505.786590:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.114@tcp lock: ffff9b68e66efa00/0x762f55027be915cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x762f55027be915d2 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664506.156170:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664506.808289:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664506.808337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664506.808390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664506.808414:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204446208 00000100:00100000:1.0:1788664506.808417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664506.808424:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204446208 00000100:00100000:1.0:1788664506.808434:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664506.808449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664506.808467:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664506.808488:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204446464 00000100:00100000:0.0:1788664506.808492:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204446464 00000100:00100000:1.0:1788664506.808498:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445824 00000100:00100000:1.0:1788664506.808500:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445824 00000100:00100000:0.0:1788664506.808506:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204446080 00000100:00100000:0.0:1788664506.808508:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204446080 00000100:00100000:0.0:1788664506.808518:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204446592 00000100:00100000:0.0:1788664506.808520:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204446592 00000100:00100000:1.0:1788664506.808526:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:1.0:1788664506.808535:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:2358:x1875550204445824:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664506.808548:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788664506.808554:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204446208:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:0.0:1788664506.808619:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204446208:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664506.808627:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788664506.808644:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788664506.808662:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204446464:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664506.808841:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:2358:x1875550204445824:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 305us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664506.808849:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 122 00000100:00100000:3.0:1788664506.808871:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788664506.808879:0:15067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788664506.808987:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788664506.808992:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788664506.809034:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:3.0:1788664506.809042:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204446080:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664506.809069:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2358:x1875550204446080:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664506.809075:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:3.0:1788664506.809087:0:15067:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788664506.809093:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:3.0:1788664506.809099:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204446592:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664506.809132:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204446592:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 33us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664506.809139:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788664506.809221:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204445952 00000100:00100000:2.0:1788664506.809228:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204445952 00000100:00100000:3.0:1788664506.809248:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204446336 00000100:00100000:3.0:1788664506.809252:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204446336 00000100:00100000:2.0:1788664506.809266:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788664506.809279:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2358:x1875550204445952:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664506.809334:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2358:x1875550204445952:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 62us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664506.809420:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2358:x1875550204446464:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 768us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664506.809427:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00080000:0.0:1788664506.809455:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788664506.811122:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:3.0:1788664506.811141:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2358:x1875550204446336:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:3.0:1788664506.811219:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2358:x1875550204446336:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 78us (2759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664506.811227:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:2.0:1788664506.813563:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788664507.167809:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788664507.167835:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c60d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222267648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788664507.167914:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664507.168090:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222267648 00000100:00100000:1.0:1788664507.168099:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222267648 00000100:00100000:1.0:1788664507.168175:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788664507.168185:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222267648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788664507.168231:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664507.168278:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222267648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664507.168285:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788664507.168362:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788664507.168543:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c60d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222267648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788664507.169963:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664507.418834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.418932:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204446720 00000100:00100000:0.0:1788664507.418943:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204446720 00000100:00100000:0.0:1788664507.418999:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:0.0:1788664507.419009:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+6:14437:x1875550204446720:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664507.419031:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664507.419054:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee800/0x762f55027be915d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bcd expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419133:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419148:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419159:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419201:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419210:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419216:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419597:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be915ee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419607:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be915ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419615:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be915ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664507.419640:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788664507.419644:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664507.419679:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be915ee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419689:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419696:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419703:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419719:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68e66efe00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.419724:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419731:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419742:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:0.0:1788664507.419745:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.419750:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419757:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66efe00/0x762f55027be915e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419769:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419775:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419781:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419786:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.419788:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419794:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419808:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b68e1346600) 00010000:00010000:0.0:1788664507.419811:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.419813:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419819:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419851:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ee800/0x762f55027be915d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bcd expref: 8 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419865:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3a00/0x762f55027be915ee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bcd expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.419873:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664507.419875:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664507.419877:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3a00, rc 0) 00000100:00100000:0.0:1788664507.419942:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+7:14437:x1875550204446720:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 934us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664507.419950:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:1.0:1788664507.432219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.432507:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204446976 00000100:00100000:0.0:1788664507.432519:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204446976 00000100:00100000:0.0:1788664507.432594:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788664507.432606:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+7:14437:x1875550204446976:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664507.432640:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664507.432663:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bd4 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.432944:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.432958:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.432969:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.433030:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.433038:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.433045:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.433646:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be9160a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.433658:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be9160a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.433666:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be9160a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664507.433675:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788664507.434220:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434239:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434246:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434252:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.434257:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434264:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434278:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b68e1346a00) 00010000:00010000:0.0:1788664507.434491:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.434497:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434504:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be915fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434518:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434524:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434530:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434535:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.434543:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434550:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434558:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b68e1346600) 00010000:00010000:0.0:1788664507.434561:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.434564:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.434570:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91603 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.435512:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be915f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bd4 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.435534:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2e00/0x762f55027be9160a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bd4 expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.435542:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:0.0:1788664507.435544:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.435547:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2e00, rc 0) 00000100:00100000:0.0:1788664507.435956:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14437:x1875550204446976:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 3350us (3746us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788664507.435966:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:1.0:1788664507.462147:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664507.462461:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204447104 00000100:00100000:2.0:1788664507.462472:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204447104 00000100:00100000:2.0:1788664507.462537:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:2.0:1788664507.462548:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14437:x1875550204447104:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788664507.462667:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14437:x1875550204447104:12345-192.168.202.14@tcp:59:lhsmtool_posix.0 Request processed in 121us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664507.462675:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:1.0:1788664507.480278:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664507.480435:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204447232 00000100:00100000:2.0:1788664507.480446:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204447232 00000100:00100000:2.0:1788664507.480508:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788664507.480518:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14443:x1875550204447232:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664507.480541:0:15795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664507.480565:0:15795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ba00/0x762f55027be91618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bdb expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.480935:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.480951:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.480979:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.480996:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481005:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481012:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481213:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481222:0:15795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481229:0:15795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481235:0:15795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ae00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664507.481240:0:15795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481247:0:15795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481259:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:2.0:1788664507.481263:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664507.481267:0:15795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481280:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be9161f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481877:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481887:0:15795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481894:0:15795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481899:0:15795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512be00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664507.481903:0:15795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481910:0:15795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481919:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b68c5b37200) 00010000:00010000:2.0:1788664507.481923:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664507.481926:0:15795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481932:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be91626 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481975:0:15795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ba00/0x762f55027be91618 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bdb expref: 10 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.481999:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:2.0:1788664507.482002:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664507.482006:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ba00/0x762f55027be91618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bdb expref: 10 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.482016:0:15795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512ba00, rc 0) 00000100:00100000:2.0:1788664507.482144:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14443:x1875550204447232:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 1626us (1876us total) trans 0 rc 301/301 00000100:00100000:2.0:1788664507.482152:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:1.0:1788664507.494074:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.494193:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204447360 00000100:00100000:0.0:1788664507.494203:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204447360 00000100:00100000:0.0:1788664507.494264:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788664507.494275:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14443:x1875550204447360:12345-192.168.202.14@tcp:700:lfs.0 00000100:00100000:0.0:1788664507.494421:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14443:x1875550204447360:12345-192.168.202.14@tcp:700:lfs.0 Request processed in 148us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664507.494430:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788664507.503094:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664507.503204:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204447616 00000100:00100000:2.0:1788664507.503217:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204447616 00000100:00100000:2.0:1788664507.503279:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788664507.503290:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14443:x1875550204447616:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:2.0:1788664507.503392:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664507.503420:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3600/0x762f55027be9155b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243b56 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.503443:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:2.0:1788664507.503448:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788664507.503695:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.503712:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 5 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.503722:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.503938:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 5 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.503953:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 5 pid: 14382 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664507.503969:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14382:1875550222267776:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664507.504062:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c2eea9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788664507.510904:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e05c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14382:1875550222267776:192.168.202.14@tcp:104: 00010000:00010000:3.0:1788664507.510934:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664507.511139:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664507.511211:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204447744 00000100:00100000:2.0:1788664507.511219:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204447744 00010000:00010000:2.0:1788664507.511258:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 6 pid: 14382 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664507.511307:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788664507.511317:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2361:x1875550204447744:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788664507.511334:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664507.511370:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 6 pid: 14382 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.511384:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 6 pid: 14382 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.511406:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68e66ef400/0x762f55027be91593 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bb8 expref: 6 pid: 14382 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.511421:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:2.0:1788664507.511440:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.511451:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.511458:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.511480:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664507.511529:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2361:x1875550204447744:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 212us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664507.511537:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00010000:00010000:1.0:1788664507.511676:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.511695:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.511721:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.511732:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.511741:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664507.512970:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788664507.512981:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.512988:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.512994:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.512998:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512be00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664507.513001:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.513006:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.513015:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68d41a0400) 00010000:00010000:1.0:1788664507.513017:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664507.513020:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.513024:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512be00/0x762f55027be9162d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788664507.513041:0:14382:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043cffddf reply state 000000001611220b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664507.513047:0:14382:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664507.513113:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+10:14443:x1875550204447616:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 9824us (10030us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788664507.513126:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00010000:00010000:0.0:1788664507.516055:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.516073:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.516081:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.516087:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f2400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.516091:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.516100:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.516116:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b68d41a0700) 00010000:00010000:0.0:1788664507.516119:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.516124:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.516130:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2400/0x762f55027be91634 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664507.621663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.622162:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204447872 00000100:00100000:0.0:1788664507.622172:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204447872 00000100:00100000:0.0:1788664507.622238:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:0.0:1788664507.622247:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+9:14451:x1875550204447872:12345-192.168.202.14@tcp:101:lctl.0 00010000:00010000:0.0:1788664507.622286:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664507.622310:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be9163b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243be2 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.624738:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3800/0x762f55027be91642 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.624761:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3800/0x762f55027be91642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.624773:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3800/0x762f55027be91642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664507.624825:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788664507.624829:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664507.624874:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3800/0x762f55027be91642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.624906:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2800/0x762f55027be9163b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243be2 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.624932:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3800/0x762f55027be91642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243be2 expref: 10 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.624941:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:1.0:1788664507.624945:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788664507.624949:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f3800, rc 0) 00000100:00100000:1.0:1788664507.625029:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+10:14451:x1875550204447872:12345-192.168.202.14@tcp:101:lctl.0 Request processed in 2781us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664507.625038:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:1.0:1788664507.696809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664507.697230:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204448000 00000100:00100000:3.0:1788664507.697241:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204448000 00000100:00100000:3.0:1788664507.697320:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:3.0:1788664507.697339:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c60d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+5:14452:x1875550204448000:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664507.697578:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664507.697602:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243be9 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.697661:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.697686:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.697701:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664507.697754:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788664507.697758:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788664507.697776:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.697799:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243be9 expref: 7 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.697817:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2c00/0x762f55027be91650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243be9 expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.697825:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:3.0:1788664507.697828:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788664507.697832:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2c00, rc 0) 00000100:00100000:3.0:1788664507.697894:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c60d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+6:14452:x1875550204448000:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 564us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664507.697901:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788664507.703161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.703390:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204448128 00000100:00100000:0.0:1788664507.703400:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204448128 00000100:00100000:0.0:1788664507.703675:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:0.0:1788664507.703687:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+6:14452:x1875550204448128:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664507.703710:0:15795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664507.703730:0:15795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bf0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703795:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703809:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703820:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703834:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703841:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703848:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703981:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be9166c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703989:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be9166c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.703996:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be9166c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664507.704023:0:15795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788664507.704027:0:15795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664507.704048:0:15795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be9166c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704059:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704065:0:15795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704071:0:15795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704077:0:15795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.704081:0:15795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704088:0:15795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704100:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:0.0:1788664507.704108:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.704113:0:15795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704120:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be9165e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704134:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704141:0:15795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704147:0:15795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704152:0:15795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3000 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.704154:0:15795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704159:0:15795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704166:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b68e1346300) 00010000:00010000:0.0:1788664507.704168:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.704171:0:15795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704176:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be91665 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704215:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be91657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bf0 expref: 8 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704241:0:15795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be9166c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bf0 expref: 7 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.704248:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:0.0:1788664507.704250:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664507.704252:0:15795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2600, rc 0) 00000100:00100000:0.0:1788664507.704570:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+7:14452:x1875550204448128:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 884us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664507.704585:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 22 00000100:00100000:2.0:1788664507.708680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664507.708769:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204448384 00000100:00100000:3.0:1788664507.708781:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204448384 00000100:00100000:3.0:1788664507.708880:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:3.0:1788664507.708890:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+7:14452:x1875550204448384:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664507.708912:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664507.708933:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bf7 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664507.709027:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788664507.709172:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91673 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bf7 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.709214:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:3.0:1788664507.709217:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664507.709223:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be91673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bf7 expref: 9 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.709237:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2600, rc 0) 00000100:00100000:3.0:1788664507.709304:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+8:14452:x1875550204448384:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 415us (636us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788664507.709312:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 23 00000100:00100000:2.0:1788664507.712894:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664507.712978:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204448640 00000100:00100000:3.0:1788664507.712990:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204448640 00000100:00100000:3.0:1788664507.713048:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 24 00000100:00100000:3.0:1788664507.713058:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+8:14452:x1875550204448640:12345-192.168.202.14@tcp:36:lfs.0 00010000:00010000:3.0:1788664507.713133:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788664507.713160:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2600/0x762f55027be9166c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bf0 expref: 8 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.713190:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68e1346900) 00010000:00010000:3.0:1788664507.713201:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788664507.713225:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.713238:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.713248:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788664507.713759:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004965e0c0 reply state 00000000dafe1912 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664507.713770:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788664507.713780:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788664507.713876:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+9:14452:x1875550204448640:12345-192.168.202.14@tcp:36:lfs.0 Request processed in 818us (991us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788664507.713885:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 24 00010000:00010000:3.0:1788664507.716062:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.716092:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.716100:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.716107:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68f88b2a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664507.716111:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.716119:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.716135:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68c3811200) 00010000:00010000:3.0:1788664507.716138:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788664507.716143:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.716149:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91681 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664507.722987:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664507.723089:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204448896 00000100:00100000:3.0:1788664507.723102:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204448896 00000100:00100000:3.0:1788664507.723167:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:3.0:1788664507.723188:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+8:14452:x1875550204448896:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:3.0:1788664507.723485:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+9:14452:x1875550204448896:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 307us (506us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788664507.723492:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:0.0:1788664507.726964:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664507.727049:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204449152 00000100:00100000:2.0:1788664507.727059:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204449152 00000100:00100000:2.0:1788664507.727125:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788664507.727135:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+9:14452:x1875550204449152:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:2.0:1788664507.727161:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664507.727191:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be91688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243bfe expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727265:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727280:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727307:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727322:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727331:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727338:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664507.727684:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788664507.727773:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727781:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727788:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727794:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664507.727799:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727806:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727818:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:2.0:1788664507.727821:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664507.727833:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727839:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be9168f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727851:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727857:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727863:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727868:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664507.727871:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727876:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727882:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b68c5b37200) 00010000:00010000:2.0:1788664507.727885:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664507.727887:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727893:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a200/0x762f55027be91696 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727932:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be91688 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bfe expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727952:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:2.0:1788664507.727954:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788664507.727958:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b200/0x762f55027be91688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243bfe expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.727967:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b200, rc 0) 00000100:00100000:2.0:1788664507.728073:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+10:14452:x1875550204449152:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 939us (1118us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788664507.728080:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 25 00000100:00100000:2.0:1788664507.735223:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.735311:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204449280 00000100:00100000:0.0:1788664507.735320:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204449280 00000100:00100000:0.0:1788664507.735414:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:0.0:1788664507.735424:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+10:14452:x1875550204449280:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:0.0:1788664507.735459:0:15795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664507.735490:0:15795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be916a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c05 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.735576:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.735590:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.735603:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664507.735646:0:15795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788664507.735650:0:15795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664507.735669:0:15795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.735697:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be916a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 12 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.735716:0:15795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 11 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.735724:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:0.0:1788664507.735727:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788664507.735731:0:15795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3000, rc 0) 00000100:00100000:0.0:1788664507.735787:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+11:14452:x1875550204449280:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 365us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664507.735793:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 26 00000100:00100000:1.0:1788664507.740323:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664507.740478:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204449408 00000100:00100000:3.0:1788664507.740488:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204449408 00000100:00100000:3.0:1788664507.740543:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:3.0:1788664507.740552:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+11:14452:x1875550204449408:12345-192.168.202.14@tcp:37:lfs.0 00000100:00100000:2.0:1788664507.746117:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6b12abac-893f-40cc-90ed-06a46322c2d8+11:14452:x1875550204449408:12345-192.168.202.14@tcp:37:lfs.0 Request processed in 5554us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664507.746132:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:2.0:1788664507.749764:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664507.750087:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204449664 00000100:00100000:1.0:1788664507.750098:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204449664 00000100:00100000:1.0:1788664507.750158:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:1.0:1788664507.750168:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f87c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+11:14452:x1875550204449664:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:1.0:1788664507.750686:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f87c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+12:14452:x1875550204449664:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 517us (931us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788664507.750695:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:3.0:1788664507.822229:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664507.823764:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204449792 00000100:00100000:1.0:1788664507.823780:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204449792 00000100:00100000:2.0:1788664507.824008:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:2.0:1788664507.824020:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+10:14458:x1875550204449792:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788664507.824055:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664507.824078:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be916b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c0c expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824149:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824165:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824208:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824224:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824232:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824240:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824412:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b600/0x762f55027be916c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824437:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b600/0x762f55027be916c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824445:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b600/0x762f55027be916c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664507.824699:0:14382:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788664507.824704:0:14382:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664507.824746:0:14382:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b600/0x762f55027be916c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824758:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824766:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824784:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824791:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664507.824796:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824804:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824817:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:2.0:1788664507.824821:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664507.824826:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824833:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be916b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824846:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824852:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824859:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824864:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512aa00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664507.824868:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824884:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824893:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b68c5b37200) 00010000:00010000:2.0:1788664507.824895:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664507.824898:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824905:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824940:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be916b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c0c expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824954:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b600/0x762f55027be916c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c0c expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.824962:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:2.0:1788664507.824965:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788664507.824967:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b600, rc 0) 00000100:00100000:2.0:1788664507.825184:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14458:x1875550204449792:12345-192.168.202.14@tcp:101:bash.0 Request processed in 1157us (2955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664507.825192:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 27 00000100:00100000:2.0:1788664507.837213:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.837378:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204450048 00000100:00100000:0.0:1788664507.837390:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204450048 00000100:00100000:0.0:1788664507.837672:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 28 00000100:00100000:0.0:1788664507.837685:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14458:x1875550204450048:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:0.0:1788664507.837708:0:15795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664507.837730:0:15795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be916ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c13 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.837847:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.837879:0:15795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 11 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.837889:0:15795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.837925:0:15795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 11 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.837939:0:15795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 11 pid: 15795 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664507.837953:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15795:1875550222267904:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664507.838228:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f85abcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788664507.851821:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664507.851930:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15795:1875550222267904:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664507.851964:0:15795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664507.852114:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204450176 00000100:00100000:1.0:1788664507.852122:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204450176 00010000:00010000:1.0:1788664507.852160:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 12 pid: 15795 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664507.852826:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788664507.852838:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+12:2360:x1875550204450176:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664507.852856:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664507.852864:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 12 pid: 15795 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.852878:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 12 pid: 15795 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.852898:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3000/0x762f55027be916ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c05 expref: 12 pid: 15795 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.852913:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:1.0:1788664507.852932:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.852942:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.852951:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664507.852982:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664507.853051:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6b12abac-893f-40cc-90ed-06a46322c2d8+11:2360:x1875550204450176:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 216us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664507.853059:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00010000:00010000:0.0:1788664507.853395:0:15795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.853403:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.853440:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.853450:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.853465:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854186:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854197:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854204:0:15795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664507.854214:0:15795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788664507.854244:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854250:0:15795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854257:0:15795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854262:0:15795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3600 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.854267:0:15795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854274:0:15795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854282:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:0.0:1788664507.854286:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.854297:0:15795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854303:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3600/0x762f55027be916d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664507.854317:0:15795:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000030d9cd1 reply state 00000000532363af transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664507.854325:0:15795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788664507.854421:0:15795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be916ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 14 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854436:0:15795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 13 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.854444:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:0.0:1788664507.854446:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788664507.854449:0:15795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2400, rc 0) 00000100:00100000:0.0:1788664507.854503:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14458:x1875550204450048:12345-192.168.202.14@tcp:101:bash.0 Request processed in 16821us (17300us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788664507.854510:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 28 00010000:00010000:0.0:1788664507.859200:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.859218:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.859226:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.859256:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3200 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664507.859262:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.859271:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.859290:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b68e1346e00) 00010000:00010000:0.0:1788664507.859294:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788664507.859299:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664507.859306:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be916dc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664507.871709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664507.871893:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204450304 00000100:00100000:2.0:1788664507.871904:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204450304 00000100:00100000:2.0:1788664507.871963:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:2.0:1788664507.871996:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+13:14458:x1875550204450304:12345-192.168.202.14@tcp:101:bash.0 00010000:00010000:2.0:1788664507.872026:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664507.872047:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be916f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c1a expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.872131:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.872145:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.872156:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664507.872206:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788664507.872211:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788664507.872230:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.872240:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.872265:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a800/0x762f55027be916f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 15 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.872284:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 14 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664507.872292:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664507.872296:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664507.872308:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512aa00, rc 0) 00000100:00100000:2.0:1788664507.872420:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14458:x1875550204450304:12345-192.168.202.14@tcp:101:bash.0 Request processed in 426us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664507.872436:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 29 00000100:00100000:3.0:1788664507.882021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664507.882620:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204450560 00000100:00100000:2.0:1788664507.882632:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204450560 00000100:00100000:2.0:1788664507.882699:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:2.0:1788664507.882710:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14458:x1875550204450560:12345-192.168.202.14@tcp:35:bash.0 00000100:00100000:2.0:1788664507.883155:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+15:14458:x1875550204450560:12345-192.168.202.14@tcp:35:bash.0 Request processed in 446us (1141us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788664507.883164:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:0.0:1788664507.997592:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664507.997723:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204450816 00000100:00100000:3.0:1788664507.997735:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204450816 00000100:00100000:3.0:1788664507.997799:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:3.0:1788664507.997810:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+15:14468:x1875550204450816:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664507.997836:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664507.997858:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be916ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c21 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664507.997958:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788664507.998105:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be916ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c21 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.998141:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b68e1346600) 00010000:00010000:3.0:1788664507.998144:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788664507.998151:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be916ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c21 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664507.998174:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2a00, rc 0) 00000100:00100000:3.0:1788664507.998242:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+16:14468:x1875550204450816:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 434us (662us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788664507.998250:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:3.0:1788664508.002163:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664508.002265:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204451072 00000100:00100000:2.0:1788664508.002276:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204451072 00000100:00100000:2.0:1788664508.002391:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:2.0:1788664508.002402:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68d1464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+16:14468:x1875550204451072:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664508.002856:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68d1464700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+17:14468:x1875550204451072:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 453us (702us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788664508.002864:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00080000:0.0:1788664508.003016:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788664508.050793:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664508.050893:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204451328 00000100:00100000:3.0:1788664508.050902:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204451328 00000100:00100000:3.0:1788664508.050965:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:3.0:1788664508.050976:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+17:14471:x1875550204451328:12345-192.168.202.14@tcp:101:lfs.0 00010000:00010000:3.0:1788664508.051001:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788664508.051021:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be9170d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c28 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.051130:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91714 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.051146:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91714 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.051160:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91714 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788664508.051210:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788664508.051393:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2600/0x762f55027be9170d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c28 expref: 20 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.051414:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91714 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c28 expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.051731:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:3.0:1788664508.051735:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788664508.051738:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68f88b2a00, rc 0) 00000100:00100000:3.0:1788664508.051805:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+19:14471:x1875550204451328:12345-192.168.202.14@tcp:101:lfs.0 Request processed in 830us (1022us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788664508.051812:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:3.0:1788664508.054631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664508.054765:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204451456 00000100:00100000:1.0:1788664508.054774:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204451456 00000100:00100000:1.0:1788664508.054836:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:1.0:1788664508.054846:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+19:14471:x1875550204451456:12345-192.168.202.14@tcp:54:lfs.0 00010000:00010000:1.0:1788664508.054916:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.054933:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.054945:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.054970:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.054979:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.055002:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.055008:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f2800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664508.055012:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.055019:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.055030:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:1.0:1788664508.055033:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664508.055038:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.055045:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2800/0x762f55027be91722 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664508.055136:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+19:14471:x1875550204451456:12345-192.168.202.14@tcp:54:lfs.0 Request processed in 292us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664508.055145:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 32 00000100:00100000:0.0:1788664508.057515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664508.057595:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204451712 00000100:00100000:2.0:1788664508.057604:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204451712 00000100:00100000:2.0:1788664508.057653:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788664508.057663:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+19:14471:x1875550204451712:12345-192.168.202.14@tcp:35:lfs.0 00000100:00100000:2.0:1788664508.057881:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+20:14471:x1875550204451712:12345-192.168.202.14@tcp:35:lfs.0 Request processed in 218us (373us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788664508.057888:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:2.0:1788664508.072718:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664508.077234:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204451840 00000100:00100000:0.0:1788664508.077250:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204451840 00000100:00100000:0.0:1788664508.077376:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788664508.077389:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+20:2358:x1875550204451840:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664508.077407:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664508.077441:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68f88b2a00/0x762f55027be91714 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c28 expref: 20 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.077463:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:0.0:1788664508.077468:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664508.077565:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+19:2358:x1875550204451840:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 178us (4856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664508.077574:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00010000:00010000:0.0:1788664508.191765:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788664508.320687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664508.320906:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204452096 00000100:00100000:2.0:1788664508.320918:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204452096 00000100:00100000:2.0:1788664508.320984:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:2.0:1788664508.320995:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+19:14502:x1875550204452096:12345-192.168.202.14@tcp:101:cat.0 00010000:00010000:2.0:1788664508.321024:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664508.321045:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a000/0x762f55027be91729 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c2f expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.321418:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91730 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.321435:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.321448:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91730 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788664508.321459:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788664508.321669:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a000/0x762f55027be91729 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c2f expref: 22 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.321691:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91730 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c2f expref: 21 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.321700:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664508.321703:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788664508.321707:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512bc00, rc 0) 00000100:00100000:2.0:1788664508.322516:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+21:14502:x1875550204452096:12345-192.168.202.14@tcp:101:cat.0 Request processed in 1516us (1835us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788664508.322535:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 33 00000100:00100000:1.0:1788664508.330788:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664508.330839:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664508.330996:0:16499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204452480 00000100:00100000:0.0:1788664508.331007:0:16499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204452480 00000100:00100000:0.0:1788664508.331079:0:16499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:0.0:1788664508.331090:0:16499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+21:2361:x1875550204452480:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664508.331107:0:16499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664508.331133:0:16499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91730 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c2f expref: 21 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.331162:0:16499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:0.0:1788664508.331168:0:16499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664508.331228:0:16499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+20:2361:x1875550204452480:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 138us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664508.331235:0:16499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:2.0:1788664508.331372:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204452352 00000100:00100000:2.0:1788664508.331377:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204452352 00000100:00100000:2.0:1788664508.331420:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:2.0:1788664508.331430:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+20:14502:x1875550204452352:12345-192.168.202.14@tcp:35:cat.0 00000100:00100000:2.0:1788664508.331726:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c722fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+21:14502:x1875550204452352:12345-192.168.202.14@tcp:35:cat.0 Request processed in 287us (938us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788664508.331734:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 8 00000100:00100000:3.0:1788664508.414323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664508.414499:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204452736 00000100:00100000:1.0:1788664508.414509:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204452736 00000100:00100000:1.0:1788664508.414575:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:1.0:1788664508.414587:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+21:14509:x1875550204452736:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:1.0:1788664508.414617:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664508.414654:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be9173e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c36 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.414772:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.414787:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 22 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.414795:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 22 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.414803:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.414842:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 22 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.414856:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 22 pid: 14380 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664508.414869:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14379:1875550222268032:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664508.415495:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 22 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.415506:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 22 pid: 15795 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664508.415516:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14379:1875550222268160:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664508.415557:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25180 going to sleep for 11 seconds 00000100:00100000:1.0:1788664508.420592:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14379:1875550222268032:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664508.420610:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14379:1875550222268160:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664508.420640:0:14379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664508.423598:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664508.423647:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664508.423869:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204452992 00000100:00100000:0.0:1788664508.423879:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204452992 00010000:00010000:0.0:1788664508.423925:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 23 pid: 15795 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664508.423969:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204452864 00000100:00100000:0.0:1788664508.423973:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204452864 00010000:00010000:0.0:1788664508.423990:0:14368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 24 pid: 14380 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664508.424019:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788664508.424059:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c53b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+24:2361:x1875550204452992:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664508.424076:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664508.424083:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 24 pid: 15795 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424095:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 24 pid: 15795 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424117:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be916e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c13 expref: 24 pid: 15795 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424146:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:0.0:1788664508.424160:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424169:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424175:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664508.424226:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c53b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+23:2361:x1875550204452992:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 179us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664508.424234:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:0.0:1788664508.424284:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 12 00000100:00100000:0.0:1788664508.424291:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+22:2361:x1875550204452864:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664508.424298:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664508.424303:0:14368:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 22 pid: 14380 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424324:0:14368:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 22 pid: 14380 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424337:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512aa00/0x762f55027be916f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c1a expref: 22 pid: 14380 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424389:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:0.0:1788664508.424393:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424401:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424409:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664508.424434:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664508.424457:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+21:2361:x1875550204452864:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 166us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664508.424464:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 12 00010000:00010000:1.0:1788664508.425102:0:14379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.425114:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664508.425143:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788664508.425373:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be9173e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c36 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.425394:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3000/0x762f55027be91745 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c36 expref: 21 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.425403:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:1.0:1788664508.425406:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788664508.425408:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f3000, rc 0) 00000100:00100000:1.0:1788664508.425450:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+21:14509:x1875550204452736:12345-192.168.202.14@tcp:101:dd.0 Request processed in 10864us (11148us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788664508.425457:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 34 00000100:00100000:3.0:1788664508.430513:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664508.430802:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204453248 00000100:00100000:2.0:1788664508.430813:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204453248 00000100:00100000:2.0:1788664508.430874:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 35 00000100:00100000:2.0:1788664508.430885:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+21:14509:x1875550204453248:12345-192.168.202.14@tcp:36:dd.0 00010000:00010000:2.0:1788664508.431172:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.431191:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.431203:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664508.431258:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788664508.431282:0:14382:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d71d83d reply state 000000006e85e856 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664508.431291:0:14382:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788664508.431696:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+24:14509:x1875550204453248:12345-192.168.202.14@tcp:36:dd.0 Request processed in 811us (1191us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788664508.431720:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 35 00000020:00080000:2.0:1788664508.431726:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788664508.437003:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00010000:00010000:3.0:1788664508.437336:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.437431:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.437439:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.437461:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512bc00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664508.437466:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.437474:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.437491:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:3.0:1788664508.437494:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664508.437498:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664508.437505:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512bc00/0x762f55027be91753 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664508.438691:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204453376 00000100:00100000:2.0:1788664508.438706:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204453376 00000100:00100000:2.0:1788664508.439020:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 36 00000100:00100000:2.0:1788664508.439033:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+23:14509:x1875550204453376:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:2.0:1788664508.439196:0:15795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664508.439221:0:15795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be9175a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c3d expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.439287:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be9175a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c3d expref: 24 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.439486:0:15795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be9175a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c3d expref: 24 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.439509:0:15795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664508.439513:0:15795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788664508.439516:0:15795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512b800, rc 0) 00000100:00100000:2.0:1788664508.439693:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+24:14509:x1875550204453376:12345-192.168.202.14@tcp:101:dd.0 Request processed in 662us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664508.439702:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 36 00000040:00080000:0.0:1788664508.448402:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788664508.460520:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664508.460946:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204453632 00000100:00100000:2.0:1788664508.460956:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204453632 00000100:00100000:2.0:1788664508.461067:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:2.0:1788664508.461078:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+24:14509:x1875550204453632:12345-192.168.202.14@tcp:103:dd.0 00010000:00010000:2.0:1788664508.461109:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788664508.461145:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b800/0x762f55027be9175a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c3d expref: 24 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664508.461174:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664508.461179:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788664508.461242:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+23:14509:x1875550204453632:12345-192.168.202.14@tcp:103:dd.0 Request processed in 166us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664508.461249:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:3.0:1788664508.463464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664508.464837:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204453760 00000100:00100000:1.0:1788664508.464849:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204453760 00000100:00100000:1.0:1788664508.464914:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:1.0:1788664508.464939:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+23:14509:x1875550204453760:12345-192.168.202.14@tcp:58:dd.0 00010000:00010000:1.0:1788664508.465062:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.465080:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.465092:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664508.466466:0:14382:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788664508.466920:0:14382:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788664508.467004:0:14382:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788664508.467575:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+23:14509:x1875550204453760:12345-192.168.202.14@tcp:58:dd.0 Request processed in 2632us (4114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664508.467587:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 37 00000100:00100000:3.0:1788664508.470010:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664508.470222:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204453888 00000100:00100000:1.0:1788664508.470232:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204453888 00000100:00100000:1.0:1788664508.470323:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:1.0:1788664508.470334:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+23:14509:x1875550204453888:12345-192.168.202.14@tcp:101:dd.0 00010000:00010000:1.0:1788664508.470380:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664508.470400:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c44 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.470457:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.470468:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c44 expref: 24 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.470504:0:14379:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.470518:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c44 expref: 24 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.470699:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:1.0:1788664508.470703:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788664508.470709:0:14379:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c44 expref: 24 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664508.470717:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f2200, rc 0) 00000100:00100000:1.0:1788664508.470774:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+24:14509:x1875550204453888:12345-192.168.202.14@tcp:101:dd.0 Request processed in 442us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664508.470782:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 38 00000100:00100000:3.0:1788664508.705502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788664508.705525:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68f90fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222268288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788664508.705605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788664508.705936:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222268288 00000100:00100000:1.0:1788664508.705944:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222268288 00000100:00100000:1.0:1788664508.706013:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664508.706024:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222268288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788664508.706074:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788664508.706148:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875550222268288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664508.706156:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788664508.706209:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68f90fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3307:1875550222268288:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788664508.706285:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788664508.707390:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222268800:0@lo:400:kworker.0 00000100:00100000:0.0:1788664508.707441:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664508.707472:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664508.707479:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222268672:0@lo:400:kworker.0 00000100:00100000:0.0:1788664508.707520:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664508.707549:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222268800 00000100:00100000:0.0:1788664508.707554:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222268800 00000100:00100000:0.0:1788664508.707595:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222268672 00000100:00100000:0.0:1788664508.707599:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222268672 00000100:00100000:0.0:1788664508.707619:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664508.707626:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222268800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664508.707670:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875550222268800:12345-0@lo:400:kworker.0 Request processed in 44us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664508.707677:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788664508.707693:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788664508.707699:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222268672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788664508.707739:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875550222268672:12345-0@lo:400:kworker.0 Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664508.707745:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788664508.707760:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664508.707782:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875550222268672:0@lo:400:kworker.0 00000100:00100000:0.0:1788664508.707792:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3308:1875550222268800:0@lo:400:kworker.0 00000100:00100000:3.0:1788664508.707883:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222268416:0@lo:400:kworker.0 00000100:00100000:3.0:1788664508.707916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664508.707950:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222268928:0@lo:400:kworker.0 00000100:00100000:3.0:1788664508.707972:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664508.707988:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788664508.707994:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222268544:0@lo:400:kworker.0 00000100:00100000:3.0:1788664508.708017:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664508.708070:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222268544 00000100:00100000:3.0:1788664508.708074:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222268544 00000100:00100000:3.0:1788664508.708103:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664508.708110:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222268544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788664508.708183:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875550222268544:12345-0@lo:400:kworker.0 Request processed in 74us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788664508.708189:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788664508.708220:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3309:1875550222268544:0@lo:400:kworker.0 00000100:00100000:1.0:1788664508.708601:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222268928 00000100:00100000:1.0:1788664508.708615:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222268928 00000100:00100000:1.0:1788664508.708652:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664508.708659:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222268928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788664508.708950:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875550222268928:12345-0@lo:400:kworker.0 Request processed in 290us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664508.708959:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788664508.708994:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3309:1875550222268928:0@lo:400:kworker.0 00000100:00100000:0.0:1788664508.709832:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222268416 00000100:00100000:0.0:1788664508.709841:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222268416 00000100:00100000:0.0:1788664508.709889:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788664508.709897:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222268416:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788664508.710053:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788664508.710449:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33c9a8d0-b33e-4394-b03e-6cd316e78cc0+19:3309:x1875550222268416:12345-0@lo:400:kworker.0 Request processed in 551us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664508.710456:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788664508.716685:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:33c9a8d0-b33e-4394-b03e-6cd316e78cc0:3309:1875550222268416:0@lo:400:kworker.0 00010000:00010000:3.0:1788664509.215559:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788664509.264159:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000001:00080000:1.0:1788664509.264181:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:1.0:1788664509.264186:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788664509.264193:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000040:00080000:0.0:1788664509.474411:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788664509.474443:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788664509.474504:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788664509.474511:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788664509.474632:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93abb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1875550222269056:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788664509.474745:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68d415b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788664509.480624:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93abb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14412:1875550222269056:192.168.202.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788664509.486425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.486620:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204454016 00000100:00100000:0.0:1788664509.486630:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204454016 00000100:00100000:0.0:1788664509.486690:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788664509.486702:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14510:x1875550204454016:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788664509.486792:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14510:x1875550204454016:12345-192.168.202.14@tcp:900:lhsmtool_posix.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.486800:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:3.0:1788664509.492193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.493593:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204454144 00000100:00100000:1.0:1788664509.493607:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204454144 00000100:00100000:2.0:1788664509.493813:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788664509.493826:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14510:x1875550204454144:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788664509.493862:0:14382:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788664509.493979:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14510:x1875550204454144:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 156us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664509.493987:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 39 00000100:00100000:2.0:1788664509.509824:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.509946:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204454272 00000100:00100000:1.0:1788664509.509958:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204454272 00000100:00100000:1.0:1788664509.510042:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:1.0:1788664509.510054:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14510:x1875550204454272:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788664509.510148:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510168:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510181:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510261:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510296:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510303:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510325:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510334:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510371:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664509.510411:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788664509.510416:0:14380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788664509.510431:0:14380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510442:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510448:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510455:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510462:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3e00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664509.510466:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510479:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510493:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664509.510497:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664509.510502:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510508:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be9176f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510522:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510528:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510534:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510539:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664509.510542:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510547:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510554:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b68d41a0200) 00010000:00010000:1.0:1788664509.510557:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664509.510560:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510575:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be91776 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510597:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510603:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510608:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510612:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3a00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664509.510615:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510620:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510627:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:1.0:1788664509.510629:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664509.510631:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.510636:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be9177d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664509.510716:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14510:x1875550204454272:12345-192.168.202.14@tcp:34:lhsmtool_posix.0 Request processed in 664us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664509.510725:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 40 00000100:00100000:3.0:1788664509.522722:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.522829:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204454528 00000100:00100000:1.0:1788664509.522839:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204454528 00000100:00100000:1.0:1788664509.522898:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:1.0:1788664509.522907:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+11:14510:x1875550204454528:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664509.522932:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664509.522953:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be91784 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c4b expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523048:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523064:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523076:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788664509.523087:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788664509.523249:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523258:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523278:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523284:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664509.523289:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523296:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523333:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:1.0:1788664509.523337:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788664509.523388:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523395:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be9178b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523439:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be91784 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c4b expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523450:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b68e1346b00) 00010000:00010000:1.0:1788664509.523453:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788664509.523457:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be91784 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c4b expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.523467:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b67c10f3a00, rc 0) 00000100:00100000:1.0:1788664509.523534:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+12:14510:x1875550204454528:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 628us (822us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788664509.523542:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 41 00000100:00100000:3.0:1788664509.533725:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.533833:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204454656 00000100:00100000:1.0:1788664509.533844:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204454656 00000100:00100000:1.0:1788664509.533911:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:1.0:1788664509.533922:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+12:14510:x1875550204454656:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788664509.533963:0:14380:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788664509.534093:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+12:14510:x1875550204454656:12345-192.168.202.14@tcp:53:lhsmtool_posix.0 Request processed in 172us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664509.534130:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 42 00000100:00100000:0.0:1788664509.545748:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.545855:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204454912 00000100:00100000:1.0:1788664509.545867:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204454912 00000100:00100000:1.0:1788664509.545930:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:1.0:1788664509.545940:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+12:14510:x1875550204454912:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788664509.545973:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788664509.545994:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be91799 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c52 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788664509.555880:0:14379:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788664509.555893:0:14379:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788664509.555941:0:14379:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788664509.556283:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be917a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.556301:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be917a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.556314:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be917a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.556427:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3a00/0x762f55027be91799 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c52 expref: 15 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.556463:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be917a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c52 expref: 14 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.556473:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68e1346500) 00010000:00010000:0.0:1788664509.556476:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788664509.556480:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2200, rc 0) 00000100:00100000:0.0:1788664509.556566:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14510:x1875550204454912:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 10626us (10826us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788664509.556575:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 43 00000100:00100000:3.0:1788664509.569437:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.569662:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204455168 00000100:00100000:1.0:1788664509.569673:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204455168 00000100:00100000:1.0:1788664509.569722:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:1.0:1788664509.569732:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14510:x1875550204455168:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788664509.569795:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664509.569825:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2200/0x762f55027be917a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c52 expref: 14 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.569849:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68e1346500) 00010000:00010000:1.0:1788664509.569862:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788664509.569885:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.569899:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.569909:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.569947:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.569953:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.569959:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570171:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570179:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570185:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570190:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664509.570194:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570200:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570210:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b68e1346300) 00010000:00010000:1.0:1788664509.570214:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664509.570217:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570223:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3400/0x762f55027be917ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570237:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570243:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570248:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570253:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3e00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:1.0:1788664509.570255:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570261:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570268:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xcd5d32b0 (ffff9b68d41a0200) 00010000:00010000:1.0:1788664509.570270:0:14380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788664509.570273:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.570278:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcd5d32b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664509.570424:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+13:14510:x1875550204455168:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 692us (996us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788664509.570432:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 44 00000100:00100000:3.0:1788664509.582254:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664509.583392:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204455296 00000100:00100000:2.0:1788664509.583404:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204455296 00000100:00100000:2.0:1788664509.583472:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788664509.583484:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+13:14510:x1875550204455296:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788664509.583507:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788664509.583543:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be917bc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c59 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.583582:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a600/0x762f55027be917c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.583611:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a600/0x762f55027be917c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.583624:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a600/0x762f55027be917c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.583724:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be917bc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c59 expref: 15 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.583746:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a600/0x762f55027be917c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c59 expref: 14 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.583756:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:2.0:1788664509.583759:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664509.583762:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68c512a600, rc 0) 00000100:00100000:2.0:1788664509.583827:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14510:x1875550204455296:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 346us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664509.583835:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 45 00000100:00100000:2.0:1788664509.591945:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.592042:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204455552 00000100:00100000:1.0:1788664509.592052:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204455552 00000100:00100000:1.0:1788664509.592126:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 46 00000100:00100000:1.0:1788664509.592150:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14510:x1875550204455552:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788664509.592235:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.592253:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.592279:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788664509.592842:0:14380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788664509.592853:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 543576510402ns, next at 544576508039ns, rc = 0 00000004:00010000:1.0:1788664509.592939:0:14380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038b96d03 reply state 000000005fbc194b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664509.592949:0:14380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788664509.593057:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+16:14510:x1875550204455552:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 906us (1119us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788664509.593064:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 46 00010000:00010000:0.0:1788664509.602927:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.602947:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.602954:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.602960:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3e00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:0.0:1788664509.602965:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.602973:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.602994:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:0.0:1788664509.602997:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788664509.603002:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.603028:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be917ca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664509.603540:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.603771:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204455680 00000100:00100000:0.0:1788664509.603781:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204455680 00000100:00100000:0.0:1788664509.603839:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:0.0:1788664509.603849:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+15:14510:x1875550204455680:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664509.603873:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664509.603889:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c60 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.603940:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 16 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.603949:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 16 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.603962:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:0.0:1788664509.603964:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788664509.603966:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2400, rc 0) 00000100:00100000:0.0:1788664509.604014:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+16:14510:x1875550204455680:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 167us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.604020:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 47 00000100:00100000:2.0:1788664509.617820:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664509.624473:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204455808 00000100:00100000:3.0:1788664509.624490:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204455808 00000100:00080000:1.0:1788664509.628633:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788664509.628634:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788664509.628652:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2361:x1875550204455808:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788664509.629056:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2361:x1875550204455808:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 408us (11245us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788664509.629064:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:1.0:1788664509.636582:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664509.638582:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204456064 00000100:00100000:2.0:1788664509.638597:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204456064 00000100:00100000:2.0:1788664509.638675:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:2.0:1788664509.638686:0:14383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+16:14510:x1875550204456064:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788664509.638950:0:14383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+17:14510:x1875550204456064:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 266us (2379us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788664509.638958:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 9 00000100:00100000:0.0:1788664509.652334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.653784:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204456320 00000100:00100000:1.0:1788664509.653799:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204456320 00000100:00100000:1.0:1788664509.653862:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:1.0:1788664509.653872:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+17:14510:x1875550204456320:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788664509.653982:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+17:14510:x1875550204456320:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 111us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664509.653990:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 48 00000100:00100000:3.0:1788664509.662992:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.663090:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204456448 00000100:00100000:0.0:1788664509.663102:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204456448 00000100:00100000:0.0:1788664509.663179:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:0.0:1788664509.663209:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+17:14510:x1875550204456448:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664509.663232:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664509.663254:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c67 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.663326:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be917df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.663377:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be917df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.663409:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be917df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788664509.663446:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788664509.663464:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be917df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.663490:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c67 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.663507:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be917df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c67 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.663526:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:0.0:1788664509.663529:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788664509.663533:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3200, rc 0) 00000100:00100000:0.0:1788664509.663592:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+18:14510:x1875550204456448:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 384us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.663608:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 49 00000100:00100000:3.0:1788664509.670175:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.670499:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204456576 00000100:00100000:0.0:1788664509.670509:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204456576 00000100:00100000:0.0:1788664509.670565:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788664509.670576:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f90fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2359:x1875550204456576:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664509.670595:0:15067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664509.670616:0:15067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c6e expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664509.670642:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cdabe, blocks: 0x1 00010000:00010000:0.0:1788664509.670661:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788664509.670665:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664509.670675:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 7 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.670693:0:15067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 7 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.670705:0:15067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f3000, rc 0) 00000100:00100000:0.0:1788664509.670766:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f90fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+7:2359:x1875550204456576:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 192us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.670773:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:1.0:1788664509.673677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.673788:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204456832 00000100:00100000:0.0:1788664509.673797:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204456832 00000100:00100000:0.0:1788664509.673862:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:0.0:1788664509.673873:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+18:14510:x1875550204456832:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788664509.673996:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+18:14510:x1875550204456832:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 125us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.674004:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 50 00000100:00100000:2.0:1788664509.686576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.687117:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204456960 00000100:00100000:0.0:1788664509.687129:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204456960 00000100:00100000:0.0:1788664509.687193:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:0.0:1788664509.687204:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+18:14510:x1875550204456960:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788664509.829285:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1788664509.829303:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788664509.829307:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788664509.829338:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1788664509.832902:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c3e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222269184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788664509.832978:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664509.833836:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222269184 00000100:00100000:2.0:1788664509.833845:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222269184 00000100:00100000:2.0:1788664509.833904:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788664509.833914:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b67c6ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875550222269184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788664509.834081:0:15066:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788664509.834084:0:15066:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788664509.834086:0:15066:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788664509.834089:0:15066:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788664510 -> 1788664510 00002000:00010000:2.0:1788664509.834091:0:15066:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788664509.834154:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b67c6ebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875550222269184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (1175us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788664509.834163:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788664509.834210:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b68c3e07100/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788664509.834216:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c3e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3310:1875550222269184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788664509.834767:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14510:x1875550204456960:12345-192.168.202.14@tcp:44:lhsmtool_posix.0 Request processed in 147561us (148198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.834777:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 51 00000100:00100000:3.0:1788664509.840817:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.841112:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204457088 00000100:00100000:0.0:1788664509.841123:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204457088 00000100:00100000:0.0:1788664509.841218:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:0.0:1788664509.841230:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+7:2361:x1875550204457088:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788664509.841634:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+7:2361:x1875550204457088:12345-192.168.202.14@tcp:16:lhsmtool_posix.0 Request processed in 404us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.841643:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 16 00000100:00100000:2.0:1788664509.846151:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.846596:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204457344 00000100:00100000:0.0:1788664509.846607:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204457344 00000100:00100000:0.0:1788664509.846714:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 52 00000100:00100000:0.0:1788664509.846726:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14510:x1875550204457344:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788664509.846781:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664509.846808:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3200/0x762f55027be917df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c67 expref: 14 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.846848:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:0.0:1788664509.846853:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788664509.846883:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.846896:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.846906:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788664509.847132:0:14380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000994fe59f reply state 000000001897f15a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664509.847142:0:14380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788664509.847255:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+15:14510:x1875550204457344:12345-192.168.202.14@tcp:36:lhsmtool_posix.0 Request processed in 530us (1113us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788664509.847263:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 52 00010000:00010000:3.0:1788664509.849812:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.849830:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.849837:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.849857:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3800 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664509.849863:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.849873:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.849889:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:3.0:1788664509.849891:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788664509.849895:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.849900:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f3800/0x762f55027be917ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664509.853678:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.853727:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204457472 00000100:00100000:0.0:1788664509.853737:0:15066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204457472 00000100:00100000:0.0:1788664509.853856:0:15066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:0.0:1788664509.853868:0:15066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+7:14510:x1875550204457472:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788664509.853889:0:15066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788664509.853909:0:15066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x748a64a1dd243c75 expref: -99 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.853943:0:15066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 8 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.853971:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664509.853975:0:15066:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664509.853982:0:15066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.854020:0:15066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 8 pid: 15067 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.854046:0:15066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 8 pid: 15067 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664509.854061:0:15066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15066:1875550222269312:192.168.202.14@tcp:104: 00000100:00100000:0.0:1788664509.854158:0:15066:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1788664509.860426:0:15066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15066:1875550222269312:192.168.202.14@tcp:104: 00010000:00010000:0.0:1788664509.860470:0:15066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.860494:0:15066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b68d15f2c00, rc 0) 00000100:00100000:0.0:1788664509.860573:0:15066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+8:14510:x1875550204457472:12345-192.168.202.14@tcp:101:lhsmtool_posix.0 Request processed in 6706us (6903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.860585:0:15066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 17 00000100:00100000:3.0:1788664509.863847:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.863928:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204457600 00000100:00100000:1.0:1788664509.863938:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204457600 00010000:00010000:0.0:1788664509.864011:0:14366:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 8 pid: 15067 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664509.864073:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:0.0:1788664509.864083:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+8:2360:x1875550204457600:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664509.864108:0:14366:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664509.864130:0:14366:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 8 pid: 15067 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.864143:0:14366:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 8 pid: 15067 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.864166:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be917e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c6e expref: 8 pid: 15067 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.864184:0:14366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664509.864188:0:14366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664509.864195:0:14366:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.864205:0:14366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.864245:0:14366:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 7 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664509.864282:0:14366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14366:1875550222269440:192.168.202.14@tcp:105: 00000100:00100000:0.0:1788664509.864410:0:14366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68f83bf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788664509.867296:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664509.867388:0:16612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204457728 00000100:00100000:3.0:1788664509.867397:0:16612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204457728 00000100:00100000:3.0:1788664509.867469:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:3.0:1788664509.867480:0:16612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c3e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+8:2361:x1875550204457728:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788664509.867692:0:16612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788664509.867696:0:16612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788664509 00002000:00010000:3.0:1788664509.867699:0:16612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788664508 00002000:00010000:3.0:1788664509.867701:0:16612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788664510 -> 1788664509 00002000:00010000:3.0:1788664509.867703:0:16612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788664509.867768:0:16612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c3e05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+9:2361:x1875550204457728:12345-192.168.202.14@tcp:2:lhsmtool_posix.0 Request processed in 289us (483us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788664509.867776:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:0.0:1788664509.868491:0:14366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14366:1875550222269440:192.168.202.14@tcp:105: 00010000:00010000:0.0:1788664509.868517:0:14366:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664509.868561:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+8:2360:x1875550204457600:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 4479us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.868569:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 13 00000100:00100000:2.0:1788664509.871667:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.871774:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204457856 00000100:00100000:1.0:1788664509.871784:0:15064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204457856 00000100:00100000:1.0:1788664509.871849:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:1.0:1788664509.871861:0:15064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+8:2360:x1875550204457856:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788664509.871911:0:15064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.871933:0:15064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.871942:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664509.871947:0:15064:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788664509.871951:0:15064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.871988:0:15064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 8 pid: 15066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.872017:0:15064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 8 pid: 15066 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664509.872043:0:15064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b67c6ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15064:1875550222269568:192.168.202.14@tcp:104: 00000100:00100000:1.0:1788664509.872138:0:15064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c7f25600 going to sleep for 11 seconds 00000100:00100000:3.0:1788664509.875181:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.875272:0:16499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204457984 00000100:00100000:0.0:1788664509.875281:0:16499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204457984 00010000:00010000:0.0:1788664509.875320:0:16499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 9 pid: 15066 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664509.875384:0:16499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 14 00000100:00100000:0.0:1788664509.875394:0:16499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+9:2361:x1875550204457984:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788664509.875410:0:16499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788664509.875435:0:16499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 9 pid: 15066 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.875450:0:16499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 9 pid: 15066 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.875484:0:16499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664509.875489:0:16499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788664509.875514:0:16499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.875524:0:16499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664509.875543:0:16499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788664509.875606:0:16499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+9:2361:x1875550204457984:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 212us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.875613:0:16499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 14 00010000:00010000:1.0:1788664509.876278:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cfb911a/0x762f55027be917f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c75 expref: 8 pid: 15066 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664509.876297:0:15064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b67c6ebc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15064:1875550222269568:192.168.202.14@tcp:104: 00010000:00010000:1.0:1788664509.876317:0:15064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876328:0:15064:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876336:0:15064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876409:0:15064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876418:0:15064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876427:0:15064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876447:0:15064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664509.876452:0:15064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876460:0:15064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876474:0:15064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.876482:0:15064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be917fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664509.876550:0:15064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:858d447e-f0c4-466d-ab69-4a91760bbec5+7:2360:x1875550204457856:12345-192.168.202.14@tcp:1:lhsmtool_posix.0 Request processed in 4692us (4895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664509.876558:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:3.0:1788664509.879233:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664509.879396:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204458240 00000100:00100000:2.0:1788664509.879406:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204458240 00000100:00100000:2.0:1788664509.879526:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 53 00000100:00100000:2.0:1788664509.879537:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+14:14510:x1875550204458240:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788664509.879630:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.879648:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.879660:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.879924:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.879936:0:14382:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 15 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.879944:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.879976:0:14382:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 15 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.879989:0:14382:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 15 pid: 14379 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664509.880002:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14382:1875550222269696:192.168.202.14@tcp:104: 00000100:00100000:2.0:1788664509.880089:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f03480 going to sleep for 11 seconds 00000100:00100000:3.0:1788664509.882770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664509.882852:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204458368 00000100:00100000:1.0:1788664509.882860:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204458368 00010000:00010000:1.0:1788664509.882898:0:14367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 16 pid: 14379 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664509.882939:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 15 00000100:00100000:1.0:1788664509.882949:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+16:2360:x1875550204458368:12345-192.168.202.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788664509.882964:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788664509.882985:0:14367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 16 pid: 14379 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.883009:0:14367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 16 pid: 14379 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.883033:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:1.0:1788664509.883039:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.883048:0:14367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.883055:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.883072:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788664509.883131:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+16:2360:x1875550204458368:12345-192.168.202.14@tcp:103:ldlm_bl.0 Request processed in 183us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664509.883138:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 15 00010000:00010000:2.0:1788664509.883884:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68d15f2400/0x762f55027be917d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c60 expref: 15 pid: 14379 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664509.883909:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14382:1875550222269696:192.168.202.14@tcp:104: 00010000:00010000:2.0:1788664509.883930:0:14382:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.883939:0:14382:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.883945:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664509.884148:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788664509.884305:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788664509.886804:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788664509.886949:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14382:1875550222269824:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788664509.887121:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788664509.887159:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8f03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788664509.887260:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222269824 00000100:00100000:0.0:1788664509.887268:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222269824 00000100:00100000:0.0:1788664509.887322:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788664509.887332:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14382:x1875550222269824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788664509.887443:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14382:x1875550222269824:12345-0@lo:1000:mdt00_002.0 Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664509.887451:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788664509.887554:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68e7edf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14382:1875550222269824:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788664509.888243:0:14382:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788664509.888303:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14382:1875550222269952:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788664509.888340:0:14382:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788664509.888383:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8da8540 going to sleep for 11 seconds 00000100:00100000:2.0:1788664509.888553:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222269952 00000100:00100000:2.0:1788664509.888558:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222269952 00000100:00100000:2.0:1788664509.888583:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788664509.888590:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14382:x1875550222269952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788664509.888744:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14382:x1875550222269952:12345-0@lo:1000:mdt00_002.0 Request processed in 154us (403us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788664509.888752:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788664509.889195:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14382:1875550222269952:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788664509.889229:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889239:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889258:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889266:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512ae00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664509.889270:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889279:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889296:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:3.0:1788664509.889299:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664509.889304:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889323:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512ae00/0x762f55027be91809 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889383:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889390:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889396:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889401:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f2c00 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:3.0:1788664509.889405:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889411:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889420:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:3.0:1788664509.889422:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788664509.889429:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c44 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889442:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c44 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889451:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c44 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664509.889641:0:14382:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2200/0x762f55027be91768 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.14@tcp remote: 0x748a64a1dd243c44 expref: 18 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664509.889655:0:14382:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c12aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14382:1875550222270080:192.168.202.14@tcp:105: 00000100:00100000:3.0:1788664509.889721:0:14382:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b68c8da8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788664509.892282:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664509.892401:0:14382:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c12aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14382:1875550222270080:192.168.202.14@tcp:105: 00010000:00010000:2.0:1788664509.892436:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892461:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f2c00/0x762f55027be91761 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892510:0:14382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892524:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892536:0:14382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892547:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892553:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892560:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892566:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512a400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664509.892570:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892578:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892588:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664509.892591:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788664509.892595:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892607:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512a400/0x762f55027be91810 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892619:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892625:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892631:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892635:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68c512b400 already unused, calling callback (ffffffffc1fdd4f0) 00010000:00010000:2.0:1788664509.892639:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892644:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892653:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b68e1346100) 00010000:00010000:2.0:1788664509.892655:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788664509.892659:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.892664:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b68c512b400/0x762f55027be91802 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14382 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788664509.892889:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+18:14510:x1875550204458240:12345-192.168.202.14@tcp:57:lhsmtool_posix.0 Request processed in 13352us (13665us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788664509.892898:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 53 00000020:00080000:2.0:1788664509.892910:0:14382:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788664509.893123:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788664509.893128:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788664509.893156:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788664509.893163:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788664509.895375:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664509.895949:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204458496 00000100:00100000:0.0:1788664509.895959:0:14383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204458496 00000100:00100000:1.0:1788664509.896081:0:14384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204458752 00000100:00100000:1.0:1788664509.896086:0:14384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204458752 00000100:00100000:1.0:1788664509.896125:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788664509.896135:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f87450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+19:14509:x1875550204458496:12345-192.168.202.14@tcp:49:dd.0 00000100:00100000:1.0:1788664509.896284:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f87450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+19:14509:x1875550204458496:12345-192.168.202.14@tcp:49:dd.0 Request processed in 149us (4011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664509.896292:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 10 00000100:00100000:1.0:1788664509.896337:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 11 00000100:00100000:1.0:1788664509.896389:0:14384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+18:14510:x1875550204458752:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788664509.904294:0:14384:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788664509.904750:0:14384:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788664509.904815:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.904834:0:14384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.904846:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.904856:0:14384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.904862:0:14384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.904869:0:14384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664509.904895:0:14384:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788664509.905143:0:14369:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788664509.905151:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.905158:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3e00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:2.0:1788664509.905162:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.905169:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.905182:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b68c5b37200) 00010000:00010000:2.0:1788664509.905185:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788664509.905189:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.905195:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b67c10f3e00/0x762f55027be91817 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14384 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664509.905208:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664509.905210:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788664509.905211:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788664509.905261:0:14384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+20:14510:x1875550204458752:12345-192.168.202.14@tcp:35:lhsmtool_posix.0 Request processed in 8860us (9905us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788664509.905272:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 11 00000020:00080000:1.0:1788664509.905278:0:14384:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788664510.003240:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664510.003282:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664510.003337:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:1.0:1788664510.003484:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204458880 00000100:00100000:1.0:1788664510.003493:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204458880 00000100:00100000:1.0:1788664510.003536:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459008 00000100:00100000:1.0:1788664510.003538:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459008 00000100:00100000:1.0:1788664510.003545:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459136 00000100:00100000:1.0:1788664510.003546:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459136 00000100:00100000:1.0:1788664510.003564:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:1.0:1788664510.003572:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+9:2361:x1875550204458880:12345-192.168.202.14@tcp:4:dd.0 00002000:00010000:1.0:1788664510.003621:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9cdabd, atime: 0x6a9cdabc, ctime: 0x6a9cdabd, blocks: 0x1 00010000:00010000:1.0:1788664510.003632:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.003650:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788664510.003655:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664510.003660:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.003672:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788664510.067806:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1788664510.067816:0:15071:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788664509 -> 1788664510 00002000:00010000:0.0:1788664510.067819:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788664510.067833:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.067848:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.067877:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.067886:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f3400 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664510.067891:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.067914:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.067938:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.067947:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2a40987/0x762f55027be9181e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664510.068053:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+11:2361:x1875550204458880:12345-192.168.202.14@tcp:4:dd.0 Request processed in 64475us (64814us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788664510.068069:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 0 00000100:00100000:0.0:1788664510.068116:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:0.0:1788664510.068130:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+10:2360:x1875550204459008:12345-192.168.202.14@tcp:4:dd.0 00002000:00010000:0.0:1788664510.068169:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6a9cdabe, atime: 0x6a9cdabc, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1788664510.068177:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.068199:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788664510.068204:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.068210:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.068224:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788664510.069616:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1788664510.069644:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1788664510.124290:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1788664510.124452:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1788664510.124458:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:1.0:1788664510.124473:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124485:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124493:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124500:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:1.0:1788664510.124506:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124529:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124549:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124557:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91825 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788664510.124652:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+6:2360:x1875550204459008:12345-192.168.202.14@tcp:4:dd.0 Request processed in 56523us (121364us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788664510.124662:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 1 00000100:00100000:1.0:1788664510.124697:0:15071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 2 00000100:00100000:1.0:1788664510.124709:0:15071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2361:x1875550204459136:12345-192.168.202.14@tcp:4:dd.0 00002000:00010000:1.0:1788664510.124749:0:15071:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9cdabe, atime: 0x6a9cdabc, ctime: 0x0, blocks: 0x1007 00010000:00010000:1.0:1788664510.124755:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124766:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788664510.124770:0:15071:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788664510.124777:0:15071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788664510.124789:0:15071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788664510.168778:0:15071:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788664510.168788:0:15071:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788664510.168803:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.168817:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.168826:0:15071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.168834:0:15071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b67c10f2a00 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664510.168839:0:15071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.168848:0:15071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.168869:0:15071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.168893:0:15071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030100c5a/0x762f55027be9182c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664510.169164:0:15071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:858d447e-f0c4-466d-ab69-4a91760bbec5+7:2361:x1875550204459136:12345-192.168.202.14@tcp:4:dd.0 Request processed in 44454us (165821us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788664510.169180:0:15071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 2 00000001:00080000:0.0:1788664510.175200:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:3.0:1788664510.175577:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664510.175656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664510.176125:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:3.0:1788664510.176266:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:0.0:1788664510.176456:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459264 00000100:00100000:0.0:1788664510.176468:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459264 00000100:00100000:0.0:1788664510.176524:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459520 00000100:00100000:0.0:1788664510.176526:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459520 00000100:00100000:0.0:1788664510.176540:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459776 00000100:00100000:0.0:1788664510.176542:0:15072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459776 00000100:00100000:0.0:1788664510.176558:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:0.0:1788664510.176567:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+7:2360:x1875550204459264:12345-192.168.202.14@tcp:4:dd.0 00002000:00010000:0.0:1788664510.176620:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9cdabe, atime: 0x6a9cdabc, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1788664510.176629:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.176645:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788664510.176650:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.176655:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.176687:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664510.182108:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788664510.182129:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788664510.182262:0:15070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459392 00000100:00100000:0.0:1788664510.182273:0:15070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459392 00000100:00100000:0.0:1788664510.182748:0:16617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788664510.182761:0:16617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+9:2360:x1875550204459520:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:0.0:1788664510.182795:0:16617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.182813:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.182817:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.182823:0:16617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.182838:0:16617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664510.184765:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664510.185890:0:15070:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788664510.185915:0:15070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788664510.187497:0:15071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459648 00000100:00100000:1.0:1788664510.187511:0:15071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459648 00000100:00100000:0.0:1788664510.193845:0:16618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 5 00000100:00100000:0.0:1788664510.193864:0:16618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:858d447e-f0c4-466d-ab69-4a91760bbec5+11:2360:x1875550204459776:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:0.0:1788664510.193921:0:16618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.193954:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.193958:0:16618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.193966:0:16618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.193981:0:16618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788664510.243449:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1788664510.248175:0:15072:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:0.0:1788664510.248185:0:15072:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788664510 -> 1788664511 00002000:00010000:0.0:1788664510.248188:0:15072:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788664511 00002000:00010000:0.0:1788664510.248191:0:15072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:0.0:1788664510.248207:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248222:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248238:0:15072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248246:0:15072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664510.248251:0:15072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248278:0:15072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248300:0:15072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248309:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be91833 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664510.248437:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+15:2360:x1875550204459264:12345-192.168.202.14@tcp:4:dd.0 Request processed in 71866us (72860us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788664510.248448:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 3 00000100:00100000:0.0:1788664510.248482:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 6 00000100:00100000:0.0:1788664510.248494:0:15072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+14:2360:x1875550204459392:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:0.0:1788664510.248524:0:15072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248537:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.248542:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.248548:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.248561:0:15072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788664510.259607:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788664510.289766:0:16617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.289788:0:16617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.289798:0:16617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.289805:0:16617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664510.289811:0:16617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.289821:0:16617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.289842:0:16617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.289849:0:16617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c0c842b/0x762f55027be9183a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664510.289944:0:16617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+16:2360:x1875550204459520:12345-192.168.202.14@tcp:4:dd.0 Request processed in 107182us (114283us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788664510.289955:0:16617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 4 00000100:00100000:0.0:1788664510.292438:0:16617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 7 00000100:00100000:0.0:1788664510.292454:0:16617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+15:2360:x1875550204459648:12345-192.168.202.14@tcp:4:dd.0 00010000:00010000:0.0:1788664510.292492:0:16617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292510:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.292515:0:16617:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788664510.292522:0:16617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292535:0:16617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292847:0:16618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292858:0:16618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292866:0:16618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292872:0:16618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f2800 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664510.292876:0:16618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292886:0:16618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292909:0:16618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.292917:0:16618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000093867ad/0x762f55027be91841 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664510.293078:0:16618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:858d447e-f0c4-466d-ab69-4a91760bbec5+14:2360:x1875550204459776:12345-192.168.202.14@tcp:4:dd.0 Request processed in 99218us (116952us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788664510.293097:0:16618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 5 00000001:00080000:0.0:1788664510.293127:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:1.0:1788664510.338305:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1788664510.344743:0:15072:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1788664510.344766:0:15072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.344779:0:15072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.344788:0:15072:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.344795:0:15072:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3000 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:0.0:1788664510.344800:0:15072:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.344809:0:15072:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.344842:0:15072:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788664510.344850:0:15072:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037da8022/0x762f55027be91848 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788664510.344947:0:15072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+9:2360:x1875550204459392:12345-192.168.202.14@tcp:4:dd.0 Request processed in 96452us (168675us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788664510.344958:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 6 00000001:00080000:0.0:1788664510.372412:0:7657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1788664510.372545:0:16617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.372561:0:16617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.372570:0:16617:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.372579:0:16617:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b68d15f3200 already unused, calling callback (ffffffffc15967b0) 00010000:00010000:3.0:1788664510.372584:0:16617:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.372593:0:16617:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.372629:0:16617:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788664510.372638:0:16617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20e6b50/0x762f55027be9184f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788664510.372769:0:16617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2360:x1875550204459648:12345-192.168.202.14@tcp:4:dd.0 Request processed in 80314us (188007us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788664510.372780:0:16617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 7 00010000:00010000:1.0:1788664511.263863:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788664511.944836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664511.944875:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664511.944894:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664511.944919:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664511.944939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664511.944973:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664511.945000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.14@tcp (source: 12345-192.168.202.14@tcp) 00000100:00100000:2.0:1788664511.945044:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204460416 00000100:00100000:2.0:1788664511.945054:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204460416 00000100:00100000:2.0:1788664511.945108:0:15795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204460032 00000100:00100000:2.0:1788664511.945111:0:15795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204460032 00000100:00100000:2.0:1788664511.945133:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:2.0:1788664511.945142:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2361:x1875550204460416:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664511.945222:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b12abac-893f-40cc-90ed-06a46322c2d8+6:2361:x1875550204460416:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664511.945230:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 30 00000100:00100000:2.0:1788664511.945248:0:15795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:2.0:1788664511.945255:0:15795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+20:2361:x1875550204460032:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664511.945281:0:15795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:858d447e-f0c4-466d-ab69-4a91760bbec5+20:2361:x1875550204460032:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664511.945287:0:15795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 31 00000100:00100000:2.0:1788664511.945304:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204460160 00000100:00100000:2.0:1788664511.945308:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204460160 00000100:00100000:2.0:1788664511.945326:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204460672 00000100:00100000:2.0:1788664511.945337:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204460672 00000100:00100000:2.0:1788664511.945376:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204460288 00000100:00100000:2.0:1788664511.945379:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204460288 00000100:00100000:2.0:1788664511.945390:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204460544 00000100:00100000:2.0:1788664511.945392:0:15067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204460544 00000100:00100000:2.0:1788664511.945406:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788664511.945412:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68e7edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2361:x1875550204460160:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664511.945440:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68e7edf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2361:x1875550204460160:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664511.945446:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 18 00000100:00100000:2.0:1788664511.945459:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788664511.945464:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2361:x1875550204460672:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664511.945488:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2361:x1875550204460672:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 24us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664511.945494:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 19 00000100:00100000:2.0:1788664511.945504:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788664511.945511:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2361:x1875550204460288:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664511.945533:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:858d447e-f0c4-466d-ab69-4a91760bbec5+5:2361:x1875550204460288:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 22us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664511.945538:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 20 00000100:00100000:2.0:1788664511.945552:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00100000:2.0:1788664511.945557:0:15067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68f8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2361:x1875550204460544:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:2.0:1788664511.945577:0:15067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68f8f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6b12abac-893f-40cc-90ed-06a46322c2d8+5:2361:x1875550204460544:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 20us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788664511.945583:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 21 00000100:00080000:2.0:1788664511.945616:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788664511.945621:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788664511.945623:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788664511.952899:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550204459904 00000100:00100000:1.0:1788664511.952915:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550204459904 00000100:00100000:1.0:1788664511.953250:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.14@tcp, seq: 124 00000100:00100000:1.0:1788664511.953260:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68dfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:2361:x1875550204459904:12345-192.168.202.14@tcp:400:kworker.0 00000100:00100000:1.0:1788664511.953371:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68dfc41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e3ae5a8-6e10-40f2-ad30-a70c29eb325f+13:2361:x1875550204459904:12345-192.168.202.14@tcp:400:kworker.0 Request processed in 112us (8545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788664511.953378:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.14@tcp, seq: 124 00000001:02000400:3.0:1788664512.073661:0:16656:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788664512.290555:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788664512.290579:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b68c93a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222270208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788664512.290649:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788664512.290714:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875550222270208 00000100:00100000:0.0:1788664512.290721:0:15069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875550222270208 00000100:00100000:0.0:1788664512.290775:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788664512.290785:0:15069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b68c93a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222270208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788664512.290825:0:15069:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788664512.290875:0:15069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b68c93a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875550222270208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788664512.290883:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788664512.290907:0:14376:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788664512.290941:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b68c93a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3308:1875550222270208:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788664512.295432:0:14370:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788664513.311630:0:14369:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30034 lines, 30034 kept, 0 dropped, 0 bad.